Original Authors: Belinda Phipson, Anna Trigos, Matt Ritchie, Maria Doyle, Harriet Dashnow, Charity Law Based on the course RNAseq analysis in R delivered on May 11/12th 2016

Before starting this section, we will make sure we have all the relevant objects from the Differential Expression analysis present.

suppressPackageStartupMessages(library(edgeR))
load("Robjects/DE.Rdata")

Overview

  • Visualising DE results
  • Getting annotation
  • Retrieving gene models
  • Exporting browser traecks
  • Visualising results with respect to genomic location

We have a list of significantly differentially expressed genes, but the only annotation we can see is the Entrez Gene ID, which is not very informative.

edgeR provides a function plotSmear that allows us to visualise the results of a DE analysis. In a similar manner to the MA-plot for microarray data, this plot shows the log-fold change against log-counts per million, with DE genes highlighted:

summary(de <- decideTestsDGE(lrt.BvsL))
   [,1] 
-1  2957
0  11232
1   1615
detags <- rownames(dgeObj)[as.logical(de)]
plotSmear(lrt.BvsL, de.tags=detags)

However, on such a plot it would be nice to add labels to highlight the genes with most evidence for being DE, or our favourite genes. To perform such a task we need to map between the identifiers we have in the edgeR output and more familiar names.

Finally, we will look at sophisticated visualisations that allow us to incorporate information about the structure of a gene, level of sequencing coverage.

Adding annotation to the edgeR results

There are a number of ways to add annotation, but we will demonstrate how to do this using the org.Mm.eg.db package. This package is one of several organism-level packages which are re-built every 6 months. These packages are listed on the annotation section of the Bioconductor, and are installed in the same way as regular Bioconductor packages. An alternative approach is to use biomaRt, an interface to the BioMart resource. BioMart is much more comprehensive, but the organism package fit better into the Bioconductor workflow.

source("http://www.bioconductor.org/biocLite.R")
biocLite("org.Mm.eg.db")
# For Human
biocLite("org.Hs.eg.db")

The packages are larger in size that Bioconductor software pacakges, but essentially they are databases that can be used to make offline queries.

library(org.Mm.eg.db)

First we need to decide what information we want. In order to see what we can extract we can run the columns function on the annotation database.

columns(org.Mm.eg.db)
 [1] "ACCNUM"       "ALIAS"        "ENSEMBL"      "ENSEMBLPROT"  "ENSEMBLTRANS" "ENTREZID"     "ENZYME"      
 [8] "EVIDENCE"     "EVIDENCEALL"  "GENENAME"     "GO"           "GOALL"        "IPI"          "MGI"         
[15] "ONTOLOGY"     "ONTOLOGYALL"  "PATH"         "PFAM"         "PMID"         "PROSITE"      "REFSEQ"      
[22] "SYMBOL"       "UNIGENE"      "UNIPROT"     

We are going to filter the database by a key or set of keys in order to extract the information we want. Valid names for the key can be retrieved with the keytypes function.

keytypes(org.Mm.eg.db)
 [1] "ACCNUM"       "ALIAS"        "ENSEMBL"      "ENSEMBLPROT"  "ENSEMBLTRANS" "ENTREZID"     "ENZYME"      
 [8] "EVIDENCE"     "EVIDENCEALL"  "GENENAME"     "GO"           "GOALL"        "IPI"          "MGI"         
[15] "ONTOLOGY"     "ONTOLOGYALL"  "PATH"         "PFAM"         "PMID"         "PROSITE"      "REFSEQ"      
[22] "SYMBOL"       "UNIGENE"      "UNIPROT"     

We should see ENTREZID, which is the type of key we are going to use in this case. If we are unsure what values are acceptable for the key, we can check what keys are valid with keys

keys(org.Mm.eg.db, keytype="ENTREZID")[1:10]
 [1] "11287" "11298" "11302" "11303" "11304" "11305" "11306" "11307" "11308" "11350"

It is a useful sanity check to make sure that the keys you want to use are all valid. We could use %in% in this case.

## Build up the query step-by-step
my.keys <- c("50916", "110308","12293")
my.keys %in% keys(org.Mm.eg.db, keytype="ENTREZID")
[1] TRUE TRUE TRUE
all(my.keys %in% keys(org.Mm.eg.db, keytype="ENTREZID"))
[1] TRUE

Let’s build up the query step by step.

## to be filled-in interactively during the class.
select(org.Mm.eg.db,

To annotate our results, we definitely want gene symbols and perhaps the full gene name. Let’s build up our annotation information in a separate data frame using the select function.

ann <- select(org.Mm.eg.db,keys=rownames(results),columns=c("ENTREZID","SYMBOL","GENENAME"))
'select()' returned 1:1 mapping between keys and columns
# Have a look at the annotation
ann

Let’s double check that the ENTREZID column matches exactly to our results rownames.

table(ann$ENTREZID==rownames(results))

 TRUE 
15804 

We can bind in the annotation information to the results data frame. (Please note that if the select function returns a 1:many mapping then you can’t just append the annotation to the fit object.)

results.annotated <- cbind(results, ann)
results.annotated

We can save the results table using the write.csv function, which writes the results out to a csv file that you can open in excel.

write.csv(results.annotated,file="B.PregVsLacResults.csv",row.names=FALSE)

A note about deciding how many genes are significant: In order to decide which genes are differentially expressed, we usually take a cut-off of 0.05 on the adjusted p-value, NOT the raw p-value. This is because we are testing more than 15000 genes, and the chances of finding differentially expressed genes is very high when you do that many tests. Hence we need to control the false discovery rate, which is the adjusted p-value column in the results table. What this means is that if 100 genes are significant at a 5% false discovery rate, we are willing to accept that 5 will be false positives. Note that the decideTests function displays significant genes at 5% FDR.

Challenge

Re-visit the plotSmear plot from above and use the text function to add labels for the names of the top 200 most DE genes

Another common visualisation is the volcano plot which display a measure of significance on the y-axis and fold-change on the x-axis.

signif <- -log10(results.annotated$FDR)
plot(results.annotated$logFC,signif,pch=16)
points(results.annotated[detags,"logFC"],-log10(results.annotated[detags,"FDR"]),pch=16,col="red")

Before following up on the DE genes with further lab work, a recommended sanity check is to have a look at the expression levels of the individual samples for the genes of interest. We can quickly look at grouped expression using stripchart. We can use the normalised log expression values in the dgeCounts object (dgeCounts$counts).

library(RColorBrewer)
par(mfrow=c(1,3))
normCounts <- dgeObj$counts
# Let's look at the first gene in the topTable, Krt5, which has a rowname 50916
stripchart(normCounts["110308",]~group)
# This plot is ugly, let's make it better
stripchart(normCounts["110308",]~group,vertical=TRUE,las=2,cex.axis=0.8,pch=16,col=1:6,method="jitter")
# Let's use nicer colours
nice.col <- brewer.pal(6,name="Dark2")
stripchart(normCounts["110308",]~group,vertical=TRUE,las=2,cex.axis=0.8,pch=16,cex=1.3,col=nice.col,method="jitter",ylab="Normalised log2 expression",main="    Krt5")

An interactive version of the volcano plot above that includes the raw per sample values in a separate panel is possible via the glXYPlot function in the Glimma package.

library(Glimma)
group2 <- group
levels(group2) <- c("basal.lactate","basal.preg","basal.virgin","lum.lactate", "lum.preg", "lum.virgin")
glXYPlot(x=results$logFC, y=-log10(results$FDR),
         xlab="logFC", ylab="B", main="B.PregVsLac",
         counts=normCounts, groups=group2, status=de,
         anno=ann, id.column="ENTREZID", folder="volcano")

This function creates an html page (./volcano/XY-Plot.html) with a volcano plot on the left and a plot showing the log-CPM per sample for a selected gene on the right. A search bar is available to search for genes of interest.

Retrieving Genomic Locations

It might seem natural to add genomic locations to our annotation table, and possibly a bit odd that the org.Mm.eg.db package does not supply such mappings. In fact, there is a whole suite of package for performing this, and more-advanced queries. These are listed on the Bioconductor annotation page and have the prefix TxDb.

The package we will be using is TxDb.Mmusculus.UCSC.mm10.knownGene. Packages are available for other organisms and genome builds. It is even possible to build your own database if one does not exist. See vignette("GenomicFeatures") for details

source("http://www.bioconductor.org/biocLite.R")
biocLite("TxDb.Mmusculus.UCSC.mm10.knownGene")

## For Humans
biocLite("TxDb.Hsapiens.UCSC.hg19.knownGene")

We load the library in the usual fashion and create a new object to save some typing. As with the org. packages, we can query what columns are available with columns,

library(TxDb.Mmusculus.UCSC.mm10.knownGene)
Loading required package: GenomicFeatures
Loading required package: GenomeInfoDb
Loading required package: GenomicRanges
tx <- TxDb.Mmusculus.UCSC.mm10.knownGene
columns(tx)
 [1] "CDSCHROM"   "CDSEND"     "CDSID"      "CDSNAME"    "CDSSTART"   "CDSSTRAND" 
 [7] "EXONCHROM"  "EXONEND"    "EXONID"     "EXONNAME"   "EXONRANK"   "EXONSTART" 
[13] "EXONSTRAND" "GENEID"     "TXCHROM"    "TXEND"      "TXID"       "TXNAME"    
[19] "TXSTART"    "TXSTRAND"   "TXTYPE"    

The select function is used in the same manner as the org.Mm.eg.db packages.

Challenge

Use the TxDb.Mmusculus.UCSC.mm10.knownGene package to retrieve the exon coordinates for the genes 50916, 110308, 12293

Overview of GenomicRanges

One of the real strengths of the txdb.. packages is the ability of interface with GenomicRanges, which is the object type used throughout Bioconductor to manipulate Genomic Intervals.

These object types permit us to perform common operations on intervals such as overlapping and counting.

library(GenomicRanges)
my.range <-GRanges("chr1", IRanges(start=1000,end=2000))
my.range
GRanges object with 1 range and 0 metadata columns:
      seqnames       ranges strand
         <Rle>    <IRanges>  <Rle>
  [1]     chr1 [1000, 2000]      *
  -------
  seqinfo: 1 sequence from an unspecified genome; no seqlengths

Let’s try some dummy intervals with random chromsome assignments and start positions.

set.seed(05052017)
chrs <- sample(paste0("chr",1:19),100,replace=TRUE)
startPos <- sample(1:5e6,100,replace=TRUE)
my.rangesA <- GRanges(chrs, IRanges(start=startPos,width=1000))
my.rangesA
GRanges object with 100 ranges and 0 metadata columns:
        seqnames             ranges strand
           <Rle>          <IRanges>  <Rle>
    [1]    chr17 [2732950, 2733949]      *
    [2]     chr3 [2250749, 2251748]      *
    [3]    chr15 [2581981, 2582980]      *
    [4]     chr4 [3439502, 3440501]      *
    [5]    chr15 [2851346, 2852345]      *
    ...      ...                ...    ...
   [96]     chr8 [  35930,   36929]      *
   [97]    chr13 [ 644034,  645033]      *
   [98]    chr15 [1278939, 1279938]      *
   [99]     chr2 [3348995, 3349994]      *
  [100]     chr5 [4484841, 4485840]      *
  -------
  seqinfo: 18 sequences from an unspecified genome; no seqlengths

There are a number of useful functions for calculating properties of the data (such as coverage or sorting). It is even possible to convert between different chromosome naming conventions.

width(my.rangesA)
  [1] 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000
 [22] 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000
 [43] 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000
 [64] 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000
 [85] 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000 1000
sort(my.rangesA)
GRanges object with 100 ranges and 0 metadata columns:
        seqnames             ranges strand
           <Rle>          <IRanges>  <Rle>
    [1]    chr17 [ 571363,  572362]      *
    [2]    chr17 [1125242, 1126241]      *
    [3]    chr17 [1338513, 1339512]      *
    [4]    chr17 [2732950, 2733949]      *
    [5]     chr3 [ 609141,  610140]      *
    ...      ...                ...    ...
   [96]    chr14 [1658130, 1659129]      *
   [97]    chr14 [3037287, 3038286]      *
   [98]    chr14 [3805150, 3806149]      *
   [99]    chr14 [4853072, 4854071]      *
  [100]     chr7 [3795787, 3796786]      *
  -------
  seqinfo: 18 sequences from an unspecified genome; no seqlengths
coverage(my.rangesA)
RleList of length 18
$chr17
integer-Rle of length 2733949 with 8 runs
  Lengths:  571362    1000  552879    1000  212271    1000 1393437    1000
  Values :       0       1       0       1       0       1       0       1

$chr3
integer-Rle of length 3387478 with 6 runs
  Lengths:  609140    1000 1640608    1000 1134730    1000
  Values :       0       1       0       1       0       1

$chr15
integer-Rle of length 4431853 with 20 runs
  Lengths:   21661    1000  135948    1000  133119    1000 ...  210004    1000  184691    1000  390271    1000
  Values :       0       1       0       1       0       1 ...       0       1       0       1       0       1

$chr4
integer-Rle of length 4744112 with 10 runs
  Lengths:  271227    1000 1796879    1000 1101428    1000  266967    1000 1302611    1000
  Values :       0       1       0       1       0       1       0       1       0       1

$chr6
integer-Rle of length 4526564 with 12 runs
  Lengths: 1810833    1000  571823    1000 1073193    1000  554296    1000  141906    1000  368513    1000
  Values :       0       1       0       1       0       1       0       1       0       1       0       1

...
<13 more elements>
seqlevelsStyle(my.rangesA)
[1] "UCSC"
keepSeqlevels(my.rangesA,"chr19")
GRanges object with 2 ranges and 0 metadata columns:
      seqnames             ranges strand
         <Rle>          <IRanges>  <Rle>
  [1]    chr19 [3107336, 3108335]      *
  [2]    chr19 [3918859, 3919858]      *
  -------
  seqinfo: 1 sequence from an unspecified genome; no seqlengths
#seqlevelsStyle(my.rangesA) <- "Ensembl"
#my.rangesA
my.rangesB <- shift(my.rangesA, shift = 500)
my.rangesB <- resize(my.rangesB,width =sample(1:1000,100,replace = TRUE))
my.rangesB
GRanges object with 100 ranges and 0 metadata columns:
        seqnames             ranges strand
           <Rle>          <IRanges>  <Rle>
    [1]    chr17 [2733450, 2734037]      *
    [2]     chr3 [2251249, 2251485]      *
    [3]    chr15 [2582481, 2582952]      *
    [4]     chr4 [3440002, 3440135]      *
    [5]    chr15 [2851846, 2852015]      *
    ...      ...                ...    ...
   [96]     chr8 [  36430,   37283]      *
   [97]    chr13 [ 644534,  645469]      *
   [98]    chr15 [1279439, 1280030]      *
   [99]     chr2 [3349495, 3350125]      *
  [100]     chr5 [4485341, 4486290]      *
  -------
  seqinfo: 18 sequences from an unspecified genome; no seqlengths
findOverlaps(my.rangesA,my.rangesB)
Hits object with 100 hits and 0 metadata columns:
        queryHits subjectHits
        <integer>   <integer>
    [1]         1           1
    [2]         2           2
    [3]         3           3
    [4]         4           4
    [5]         5           5
    ...       ...         ...
   [96]        96          96
   [97]        97          97
   [98]        98          98
   [99]        99          99
  [100]       100         100
  -------
  queryLength: 100 / subjectLength: 100

Retrieving Gene Coordinates as GenomicRanges

It is quite straightforward to translate the output of a select query into a GenomicFeatures object. However, several convenience functions exist to retrieve the structure of every gene for a given organism in one object.

The output of exonsBy is a list, where each item in the list is the exon co-ordinates of a particular gene.

exo <- exonsBy(tx,"gene")
exo
GRangesList object of length 24116:
$100009600 
GRanges object with 7 ranges and 2 metadata columns:
      seqnames               ranges strand |   exon_id   exon_name
         <Rle>            <IRanges>  <Rle> | <integer> <character>
  [1]     chr9 [21062393, 21062717]      - |    134539        <NA>
  [2]     chr9 [21062894, 21062987]      - |    134540        <NA>
  [3]     chr9 [21063314, 21063396]      - |    134541        <NA>
  [4]     chr9 [21066024, 21066377]      - |    134542        <NA>
  [5]     chr9 [21066940, 21067925]      - |    134543        <NA>
  [6]     chr9 [21068030, 21068117]      - |    134544        <NA>
  [7]     chr9 [21073075, 21075496]      - |    134546        <NA>

$100009609 
GRanges object with 6 ranges and 2 metadata columns:
      seqnames               ranges strand | exon_id exon_name
  [1]     chr7 [84940169, 84941088]      - |  109989      <NA>
  [2]     chr7 [84943141, 84943264]      - |  109990      <NA>
  [3]     chr7 [84943504, 84943722]      - |  109991      <NA>
  [4]     chr7 [84946200, 84947000]      - |  109992      <NA>
  [5]     chr7 [84947372, 84947651]      - |  109993      <NA>
  [6]     chr7 [84963816, 84964009]      - |  109994      <NA>

$100009614 
GRanges object with 1 range and 2 metadata columns:
      seqnames               ranges strand | exon_id exon_name
  [1]    chr10 [77711446, 77712009]      + |  143986      <NA>

...
<24113 more elements>
-------
seqinfo: 66 sequences (1 circular) from mm10 genome

To access the structure of a particular gene, we can use the [[ syntax with the name of the gene (Entrez gene ID) within quote marks.

exo[["12992"]]
GRanges object with 14 ranges and 2 metadata columns:
       seqnames               ranges strand |   exon_id   exon_name
          <Rle>            <IRanges>  <Rle> | <integer> <character>
   [1]     chr5 [87808121, 87808165]      + |     68233        <NA>
   [2]     chr5 [87809897, 87809959]      + |     68234        <NA>
   [3]     chr5 [87813088, 87813114]      + |     68235        <NA>
   [4]     chr5 [87813838, 87813861]      + |     68236        <NA>
   [5]     chr5 [87813941, 87813982]      + |     68237        <NA>
   ...      ...                  ...    ... .       ...         ...
  [10]     chr5 [87819066, 87819095]      + |     68242        <NA>
  [11]     chr5 [87819066, 87819110]      + |     68243        <NA>
  [12]     chr5 [87820951, 87820995]      + |     68244        <NA>
  [13]     chr5 [87822212, 87822322]      + |     68245        <NA>
  [14]     chr5 [87824139, 87824421]      + |     68246        <NA>
  -------
  seqinfo: 66 sequences (1 circular) from mm10 genome

Exporting tracks

It is also possible to save the results of a Bioconductor analysis in a browser to enable interactive analysis and integration with other data types, or sharing with collaborators. For instance, we might want a browser track to indicate where our differentially-expressed genes are located. We shall use the bed format to display these locations. We will annotate the ranges with information from our analysis such as the fold-change and significance.

First we create a data frame for just the DE genes.

sigGenes <- results.annotated[detags,]
sigGenes

At the moment, we have a GenomicFeatures object that represents every exon. However, we do not need this level of granularity for the bed output, so we will collapse to a single region for each gene. First we the range function to obtain a single range for every gene and tranform to a more convenient object with unlist.

range(exo)
GRangesList object of length 24116:
$100009600 
GRanges object with 1 range and 0 metadata columns:
      seqnames               ranges strand
         <Rle>            <IRanges>  <Rle>
  [1]     chr9 [21062393, 21075496]      -

$100009609 
GRanges object with 1 range and 0 metadata columns:
      seqnames               ranges strand
  [1]     chr7 [84940169, 84964009]      -

$100009614 
GRanges object with 1 range and 0 metadata columns:
      seqnames               ranges strand
  [1]    chr10 [77711446, 77712009]      +

...
<24113 more elements>
-------
seqinfo: 66 sequences (1 circular) from mm10 genome
exoRanges <- unlist(range(exo))
sigRegions <- exoRanges[na.omit(match(sigGenes$ENTREZID, names(exoRanges)))]
sigRegions
GRanges object with 4393 ranges and 0 metadata columns:
         seqnames                 ranges strand
            <Rle>              <IRanges>  <Rle>
  497097     chr1     [3214482, 3671498]      -
   20671     chr1     [4490928, 4497354]      -
   58175     chr1     [4909576, 5070285]      -
   76187     chr1     [9548046, 9577968]      +
   72481     chr1     [9560833, 9631092]      -
     ...      ...                    ...    ...
  195727     chrX [161836430, 162159441]      -
  108012     chrX [163909017, 163933666]      +
   56078     chrX [163976822, 164028010]      -
   54156     chrX [166523007, 166585716]      -
  333605     chrX [167471306, 168577233]      -
  -------
  seqinfo: 66 sequences (1 circular) from mm10 genome

Rather than just representing the genomic locations, the .bed format is also able to colour each range according to some property of the analysis (e.g. direction and magnitude of change) to help highlight particular regions of interest. A score can also be displayed when a particular region is clicked-on. A useful propery of GenomicRanges is that we can attach metadata to each range using the mcols function. The metadata can be supplied in the form of a data frame.

sigRegions
GRanges object with 4393 ranges and 0 metadata columns:
         seqnames                 ranges strand
            <Rle>              <IRanges>  <Rle>
  497097     chr1     [3214482, 3671498]      -
   20671     chr1     [4490928, 4497354]      -
   58175     chr1     [4909576, 5070285]      -
   76187     chr1     [9548046, 9577968]      +
   72481     chr1     [9560833, 9631092]      -
     ...      ...                    ...    ...
  195727     chrX [161836430, 162159441]      -
  108012     chrX [163909017, 163933666]      +
   56078     chrX [163976822, 164028010]      -
   54156     chrX [166523007, 166585716]      -
  333605     chrX [167471306, 168577233]      -
  -------
  seqinfo: 66 sequences (1 circular) from mm10 genome
mcols(sigRegions) <- sigGenes[match(names(sigRegions), rownames(sigGenes)),]
sigRegions
GRanges object with 4393 ranges and 8 metadata columns:
         seqnames                 ranges strand |      logFC     logCPM        LR
            <Rle>              <IRanges>  <Rle> |  <numeric>  <numeric> <numeric>
  497097     chr1     [3214482, 3671498]      - | -10.947240  2.5236515 23.590694
   20671     chr1     [4490928, 4497354]      - |  -2.673131  1.2418640 10.587241
   58175     chr1     [4909576, 5070285]      - |   4.471434  1.1240115 14.373441
   76187     chr1     [9548046, 9577968]      + |   3.033003  2.4071013  8.475630
   72481     chr1     [9560833, 9631092]      - |   2.136618 -0.2472752  6.137581
     ...      ...                    ...    ... .        ...        ...       ...
  195727     chrX [161836430, 162159441]      - |  -4.692618  3.1077765 13.912120
  108012     chrX [163909017, 163933666]      + |  -2.176996  2.3209830 10.201704
   56078     chrX [163976822, 164028010]      - |   2.588361  5.1331379  6.923093
   54156     chrX [166523007, 166585716]      - |  -6.964350  4.3915759 19.444204
  333605     chrX [167471306, 168577233]      - |  -3.896071  0.6561936  6.917891
               PValue          FDR    ENTREZID        SYMBOL
            <numeric>    <numeric> <character>   <character>
  497097 1.191624e-06 0.0004377961      497097          Xkr4
   20671 1.138708e-03 0.0078553551       20671         Sox17
   58175 1.499018e-04 0.0020196485       58175         Rgs20
   76187 3.599356e-03 0.0182496716       76187        Adhfe1
   72481 1.323382e-02 0.0468231045       72481 2610203C22Rik
     ...          ...          ...         ...           ...
  195727 1.915593e-04 0.0023438662      195727           Nhs
  108012 1.403109e-03 0.0091706934      108012         Ap1s2
   56078 8.508968e-03 0.0338900535       56078         Car5b
   54156 1.035817e-05 0.0005205134       54156         Egfl6
  333605 8.533757e-03 0.0339270998      333605        Frmpd4
                                                   GENENAME
                                                <character>
  497097                  X-linked Kx blood group related 4
   20671              SRY (sex determining region Y)-box 17
   58175                regulator of G-protein signaling 20
   76187          alcohol dehydrogenase, iron containing, 1
   72481                         RIKEN cDNA 2610203C22 gene
     ...                                                ...
  195727                       Nance-Horan syndrome (human)
  108012 adaptor-related protein complex 1, sigma 2 subunit
   56078               carbonic anhydrase 5b, mitochondrial
   54156                        EGF-like-domain, multiple 6
  333605                   FERM and PDZ domain containing 4
  -------
  seqinfo: 66 sequences (1 circular) from mm10 genome

The metadata we have added can also by used as a means to interrogate the ranges; as if the data were contained in a data frame.

sigRegions[order(sigRegions$LR,decreasing = TRUE)]
GRanges object with 4393 ranges and 8 metadata columns:
         seqnames                 ranges strand |     logFC    logCPM        LR       PValue
            <Rle>              <IRanges>  <Rle> | <numeric> <numeric> <numeric>    <numeric>
  110308    chr15 [101707070, 101712891]      - | -8.940578 10.264297  24.89789 6.044844e-07
   50916    chr13 [ 73260497,  73269620]      + | -8.636503  5.749781  24.80037 6.358512e-07
   12293     chr5 [ 15934691,  16374511]      + | -8.362247  6.794788  24.68526 6.749827e-07
   56069    chr18 [ 61687915,  61692537]      + | -8.419433  6.124377  24.41532 7.764861e-07
   24117    chr10 [121034004, 121100642]      + | -9.290691  6.757163  24.32506 8.137331e-07
     ...      ...                    ...    ... .       ...       ...       ...          ...
   75723     chr9 [ 14541967,  14643529]      - | -1.373919  8.545179  5.988178   0.01440207
  238384    chr12 [102129419, 102267091]      + | -3.283021 -2.062221  5.986796   0.01441336
   72543     chr2 [ 33729956,  33887946]      - | -1.146311  5.243682  5.986777   0.01441351
  268301    chr10 [ 59221922,  59226433]      + |  1.393078  4.386359  5.984774   0.01442989
   20931     chr2 [ 26916421,  26920170]      + | -1.132158  4.526824  5.981059   0.01446032
                  FDR    ENTREZID      SYMBOL
            <numeric> <character> <character>
  110308 0.0004377961      110308        Krt5
   50916 0.0004377961       50916        Irx4
   12293 0.0004377961       12293    Cacna2d1
   56069 0.0004377961       56069       Il17b
   24117 0.0004377961       24117        Wif1
     ...          ...         ...         ...
   75723   0.04982713       75723      Amotl1
  238384   0.04984490      238384     Slc24a4
   72543   0.04984490       72543      Mvb12b
  268301   0.04989062      268301      Sowahc
   20931   0.04998488       20931       Surf2
                                                                        GENENAME
                                                                     <character>
  110308                                                               keratin 5
   50916                                Iroquois related homeobox 4 (Drosophila)
   12293              calcium channel, voltage-dependent, alpha2/delta subunit 1
   56069                                                         interleukin 17B
   24117                                                 Wnt inhibitory factor 1
     ...                                                                     ...
   75723                                                       angiomotin-like 1
  238384 solute carrier family 24 (sodium/potassium/calcium exchanger), member 4
   72543                                         multivesicular body subunit 12B
  268301                        sosondowah ankyrin repeat domain family member C
   20931                                                          surfeit gene 2
  -------
  seqinfo: 66 sequences (1 circular) from mm10 genome

For visualisation purposes, we are going to restrict the data to genes that are located on chromosomes 1 to 19 and the sex chromosomes. This can be done with the keepSeqLevels function.

seqlevels(sigRegions)
 [1] "chr1"                 "chr2"                 "chr3"                
 [4] "chr4"                 "chr5"                 "chr6"                
 [7] "chr7"                 "chr8"                 "chr9"                
[10] "chr10"                "chr11"                "chr12"               
[13] "chr13"                "chr14"                "chr15"               
[16] "chr16"                "chr17"                "chr18"               
[19] "chr19"                "chrX"                 "chrY"                
[22] "chrM"                 "chr1_GL456210_random" "chr1_GL456211_random"
[25] "chr1_GL456212_random" "chr1_GL456213_random" "chr1_GL456221_random"
[28] "chr4_GL456216_random" "chr4_GL456350_random" "chr4_JH584292_random"
[31] "chr4_JH584293_random" "chr4_JH584294_random" "chr4_JH584295_random"
[34] "chr5_GL456354_random" "chr5_JH584296_random" "chr5_JH584297_random"
[37] "chr5_JH584298_random" "chr5_JH584299_random" "chr7_GL456219_random"
[40] "chrX_GL456233_random" "chrY_JH584300_random" "chrY_JH584301_random"
[43] "chrY_JH584302_random" "chrY_JH584303_random" "chrUn_GL456239"      
[46] "chrUn_GL456359"       "chrUn_GL456360"       "chrUn_GL456366"      
[49] "chrUn_GL456367"       "chrUn_GL456368"       "chrUn_GL456370"      
[52] "chrUn_GL456372"       "chrUn_GL456378"       "chrUn_GL456379"      
[55] "chrUn_GL456381"       "chrUn_GL456382"       "chrUn_GL456383"      
[58] "chrUn_GL456385"       "chrUn_GL456387"       "chrUn_GL456389"      
[61] "chrUn_GL456390"       "chrUn_GL456392"       "chrUn_GL456393"      
[64] "chrUn_GL456394"       "chrUn_GL456396"       "chrUn_JH584304"      
sigRegions <- keepSeqlevels(sigRegions, paste0("chr", c(1:19,"X","Y")))

We will now create a score from the p-values that will displayed under each region, and colour scheme for the regions based on the fold-change. For the score we can use the \(-log_{10}\) of the adjusted p-value as before

Score <- -log10(sigRegions$FDR)

colorRampPalette is a useful function in base R for constructing a palette between two extremes. When choosing colour palettes, make sure they are colour blind friendly. The red / green colour scheme traditionally-applied to microarrays is a bad choice.

We will also truncate the fold-changes to between -5 and 5 to and divide this range into 10 equal bins

rbPal <-colorRampPalette(c("red", "blue"))
logfc <- pmax(sigRegions$logFC, -5)
logfc <- pmin(logfc , 5)
Col <- rbPal(10)[as.numeric(cut(logfc, breaks = 10))]

The colours and score have to be saved in the GRanges object as score and itemRgb columns respectively, and will be used to construct the browser track. The rtracklayer package can be used to import and export browsers tracks.

Now we can export the signifcant results from the DE analysis as a .bed track using rtracklayer. You can load the resulting file in IGV, if you wish.

mcols(sigRegions)$score <- Score
mcols(sigRegions)$itemRgb <- Col
sigRegions
GRanges object with 4392 ranges and 10 metadata columns:
         seqnames                 ranges strand |      logFC     logCPM        LR
            <Rle>              <IRanges>  <Rle> |  <numeric>  <numeric> <numeric>
  497097     chr1     [3214482, 3671498]      - | -10.947240  2.5236515 23.590694
   20671     chr1     [4490928, 4497354]      - |  -2.673131  1.2418640 10.587241
   58175     chr1     [4909576, 5070285]      - |   4.471434  1.1240115 14.373441
   76187     chr1     [9548046, 9577968]      + |   3.033003  2.4071013  8.475630
   72481     chr1     [9560833, 9631092]      - |   2.136618 -0.2472752  6.137581
     ...      ...                    ...    ... .        ...        ...       ...
  195727     chrX [161836430, 162159441]      - |  -4.692618  3.1077765 13.912120
  108012     chrX [163909017, 163933666]      + |  -2.176996  2.3209830 10.201704
   56078     chrX [163976822, 164028010]      - |   2.588361  5.1331379  6.923093
   54156     chrX [166523007, 166585716]      - |  -6.964350  4.3915759 19.444204
  333605     chrX [167471306, 168577233]      - |  -3.896071  0.6561936  6.917891
               PValue          FDR    ENTREZID        SYMBOL
            <numeric>    <numeric> <character>   <character>
  497097 1.191624e-06 0.0004377961      497097          Xkr4
   20671 1.138708e-03 0.0078553551       20671         Sox17
   58175 1.499018e-04 0.0020196485       58175         Rgs20
   76187 3.599356e-03 0.0182496716       76187        Adhfe1
   72481 1.323382e-02 0.0468231045       72481 2610203C22Rik
     ...          ...          ...         ...           ...
  195727 1.915593e-04 0.0023438662      195727           Nhs
  108012 1.403109e-03 0.0091706934      108012         Ap1s2
   56078 8.508968e-03 0.0338900535       56078         Car5b
   54156 1.035817e-05 0.0005205134       54156         Egfl6
  333605 8.533757e-03 0.0339270998      333605        Frmpd4
                                                   GENENAME     score     itemRgb
                                                <character> <numeric> <character>
  497097                  X-linked Kx blood group related 4  3.358728     #FF0000
   20671              SRY (sex determining region Y)-box 17  2.104834     #C60038
   58175                regulator of G-protein signaling 20  2.694724     #0000FF
   76187          alcohol dehydrogenase, iron containing, 1  1.738745     #1C00E2
   72481                         RIKEN cDNA 2610203C22 gene  1.329540     #3800C6
     ...                                                ...       ...         ...
  195727                       Nance-Horan syndrome (human)  2.630067     #FF0000
  108012 adaptor-related protein complex 1, sigma 2 subunit  2.037598     #C60038
   56078               carbonic anhydrase 5b, mitochondrial  1.469928     #3800C6
   54156                        EGF-like-domain, multiple 6  3.283568     #FF0000
  333605                   FERM and PDZ domain containing 4  1.469453     #E2001C
  -------
  seqinfo: 21 sequences from mm10 genome
library(rtracklayer)
export(sigRegions , con = "topHits.bed")

Extracting Reads

As we have been using counts as our starting point, we haven’t investigated the aligned reads from our experiment, and how they are represented. As you may be aware, aligned reads are usually stored in a bam file that can be manipulated with open-source command-line tools such as samtools and picard. Bioconductor provide a low-level interface to bam/sam files in the form of the Rsamtools package. The GenomicAlignments package can also be used to retrieve the reads mapping to a particular genomic region in an efficient manner.

library(GenomicAlignments)
generegion <- exo[["50916"]]
getwd()
bam <- readGAlignments(file="bam/MCL1.DG.bam",
                       param=ScanBamParam(which=generegion))
bam

There are various visualisation options for aligned reads and range data. We will use the ggbio package, which first requires some discussion of the ggplot2 plotting package.

Brief Introduction to ggplot2

The ggplot2 package has emerged as an attractive alternative to the traditional plots provided by base R. A full overview of all capabilities of the package is available from the cheatsheet.

A simple scatter plot, equivalent to plotSmear from before, can be generated as follows:-

library(ggplot2)
ggplot(results, aes(x = logCPM, y=logFC)) + geom_point() 

In brief:-

  • results is our data frame containing the variables we wish to plot
  • aes creates a mpping between the variables in our data frame to the aesthetic proprties of the plot
    • the x-axis is mapped to logCPM, y-axis is mapped to logFC
  • geom_point specifies the particular type of plot we want (in this case a scatter plot)

The real advantage of ggplot2 is the ability to change the appearance of our plot by mapping other variables to aspects of the plot. For example, we could colour the points based on a p-value cut-off. The colours are automatically chosen by ggplot2, but we can specifiy particular values.

ggplot(results, aes(x = logCPM, y=logFC,col=FDR < 0.05)) + geom_point()

ggplot(results, aes(x = logCPM, y=logFC,col=FDR < 0.05)) + geom_point(alpha=0.4) + scale_colour_manual(values=c("black","red"))

ggplot(results, aes(x = logCPM, y=logFC,col=FDR < 0.05)) + geom_point() + scale_colour_manual(values=c("black","red"))

The volcano plot can be constructed in a similar manner

ggplot(results, aes(x = logFC, y=-log10(FDR))) + geom_point()

Composing plots with ggbio

We will now take a brief look at one of the visualisation packages in Bioconductor that takes advantage of the GenomicRanges and GenomicFeatures object-types. In this section we will show a worked example of how to combine several types of genomic data on the same plot. The documentation for ggbio is very extensive and contains lots of examples.

http://www.tengfei.name/ggbio/docs/

The Gviz package is another Bioconductor package that specialising in genomic visualisations, but we will not explore this package in the course.

The Manhattan plot is a common way of visualising genome-wide results, and this is implemented as the plotGrandLinear function. We have to supply a value to display on the y-axis using the aes function, which is inherited from ggplot2. The positioning of points on the x-axis is handled automatically by ggbio, using the ranges information to get the genomic coordinates of the ranges of interest.

To stop the plots from being too cluttered we will consider the top 200 genes only.

library(ggbio)
Need specific help about ggbio? try mailing 
 the maintainer or visit http://tengfei.github.com/ggbio/

Attaching package: 'ggbio'

The following objects are masked from 'package:ggplot2':

    geom_bar, geom_rect, geom_segment, ggsave, stat_bin, stat_identity, xlim
top200 <- sigRegions[order(sigRegions$LR,decreasing = TRUE)[1:200]]
plotGrandLinear(top200 , aes(y = logFC))
using coord:genome to parse x scale

ggbio has alternated the colours of the chromosomes. However, an appealing feature of ggplot2 is the ability to map properties of your plot to variables present in your data. For example, we could create a variable to distinguish between up- and down-regulated genes. The variables used for aesthetic mapping must be present in the mcols section of your ranges object.

mcols(top200)$UpRegulated <- mcols(top200)$logFC > 0
plotGrandLinear(top200, aes(y = logFC, col = UpRegulated))
using coord:genome to parse x scale

plotGrandLinear is a special function in ggbio with preset options for the manhattan style of plot. More often, users will call the autoplot function and ggbio will choose the most appropriate layout. One such layout is the karyogram.

autoplot(top200,layout="karyogram",aes(color=UpRegulated,
                                       fill=UpRegulated))
Scale for 'x' is already present. Adding another scale for 'x', which will replace the
existing scale.
Scale for 'x' is already present. Adding another scale for 'x', which will replace the
existing scale.

ggbio is also able to plot the structure of genes according to a particular model represented by a GenomicFeatures object.

autoplot(tx, which=exo[["24117"]])
Parsing transcripts...
Parsing exons...
Parsing cds...
Parsing utrs...
------exons...
------cdss...
------introns...
------utr...
aggregating...
Done
Constructing graphics...

We can even plot the location of sequencing reads if they have been imported using readGAlignments function (or similar).

myreg <- flank(reduce(exo[["24117"]]), 1000, both = T)
bam <- readGAlignments(file="bam/MCL1.DG.bam",
                       param=ScanBamParam(which=myreg),use.names = TRUE)

autoplot(bam,which=myreg)
autoplot(bam , stat = "coverage")

Like ggplot2, ggbio plots can be saved as objects that can later be modified, or combined together to form more complicated plots. If saved in this way, the plot will only be displayed on a plotting device when we query the object. This strategy is useful when we want to add a common element (such as an ideogram) to a plot composition and don’t want to repeat the code to generate the plot every time.

#idPlot <- plotIdeogram(genome = "mm10",subchr = "chr1")
#idPlot
geneMod <- autoplot(tx, which = myreg)
reads1 <- autoplot(bam, stat = "coverage")
tracks(geneMod ,reads1)
LS0tCnRpdGxlOiAiUk5BLXNlcSBBbmFseXNpcyBpbiBSIgpzdWJ0aXRsZTogIkFubm90YXRpb24gYW5kIFZpc3VhbGlzYXRpb24gb2YgUk5BLXNlcSByZXN1bHRzIgphdXRob3I6ICJTdGVwaGFuZSBCYWxsZXJlYXUsIE1hcmsgRHVubmluZywgT3NjYXIgUnVlZGEsIEFzaGxleSBTYXdsZSIKZGF0ZTogJ2ByIGZvcm1hdChTeXMudGltZSgpLCAiTGFzdCBtb2RpZmllZDogJWQgJWIgJVkiKWAnCm91dHB1dDoKICBodG1sX25vdGVib29rOgogICAgdG9jOiB5ZXMKICAgIHRvY19mbG9hdDogeWVzCiAgaHRtbF9kb2N1bWVudDoKICAgIHRvYzogeWVzCiAgICB0b2NfZmxvYXQ6IHllcwptaW51dGVzOiAzMDAKbGF5b3V0OiBwYWdlCmJpYmxpb2dyYXBoeTogcmVmLmJpYgotLS0KYGBge3Igc2V0dXAsIGluY2x1ZGU9RkFMU0V9CmtuaXRyOjpvcHRzX2NodW5rJHNldChlY2hvID0gVFJVRSkKYGBgCgoqKk9yaWdpbmFsIEF1dGhvcnM6IEJlbGluZGEgUGhpcHNvbiwgQW5uYSBUcmlnb3MsIE1hdHQgUml0Y2hpZSwgTWFyaWEgRG95bGUsIEhhcnJpZXQgRGFzaG5vdywgQ2hhcml0eSBMYXcqKgpCYXNlZCBvbiB0aGUgY291cnNlIFtSTkFzZXEgYW5hbHlzaXMgaW4gUl0oaHR0cDovL2NvbWJpbmUtYXVzdHJhbGlhLmdpdGh1Yi5pby8yMDE2LTA1LTExLVJOQXNlcS8pIGRlbGl2ZXJlZCBvbiBNYXkgMTEvMTJ0aCAyMDE2CgpCZWZvcmUgc3RhcnRpbmcgdGhpcyBzZWN0aW9uLCB3ZSB3aWxsIG1ha2Ugc3VyZSB3ZSBoYXZlIGFsbCB0aGUgcmVsZXZhbnQgb2JqZWN0cyBmcm9tIHRoZSBEaWZmZXJlbnRpYWwgRXhwcmVzc2lvbiBhbmFseXNpcyBwcmVzZW50LgoKYGBge3J9CnN1cHByZXNzUGFja2FnZVN0YXJ0dXBNZXNzYWdlcyhsaWJyYXJ5KGVkZ2VSKSkKbG9hZCgiUm9iamVjdHMvREUuUmRhdGEiKQpgYGAKCiMgT3ZlcnZpZXcKCi0gVmlzdWFsaXNpbmcgREUgcmVzdWx0cwotIEdldHRpbmcgYW5ub3RhdGlvbgotIFJldHJpZXZpbmcgZ2VuZSBtb2RlbHMKLSBFeHBvcnRpbmcgYnJvd3NlciB0cmFlY2tzCi0gVmlzdWFsaXNpbmcgcmVzdWx0cyB3aXRoIHJlc3BlY3QgdG8gZ2Vub21pYyBsb2NhdGlvbgoKCgpXZSBoYXZlIGEgbGlzdCBvZiBzaWduaWZpY2FudGx5IGRpZmZlcmVudGlhbGx5IGV4cHJlc3NlZCBnZW5lcywgYnV0IHRoZSBvbmx5IGFubm90YXRpb24gd2UgY2FuIHNlZSBpcyB0aGUgRW50cmV6IEdlbmUgSUQsIHdoaWNoIGlzIG5vdCB2ZXJ5IGluZm9ybWF0aXZlLiAKYGBge3J9CnJlc3VsdHMgPC0gYXMuZGF0YS5mcmFtZSh0b3BUYWdzKGxydC5CdnNMLG4gPSBJbmYpKQpyZXN1bHRzCmRpbShyZXN1bHRzKQpgYGAKCmBlZGdlUmAgcHJvdmlkZXMgYSBmdW5jdGlvbiBgcGxvdFNtZWFyYCB0aGF0IGFsbG93cyB1cyB0byB2aXN1YWxpc2UgdGhlIHJlc3VsdHMgb2YgYSBERSBhbmFseXNpcy4gSW4gYSBzaW1pbGFyIG1hbm5lciB0byB0aGUgWypNQS1wbG90KiBmb3IgbWljcm9hcnJheSBkYXRhXShodHRwczovL2VuLndpa2lwZWRpYS5vcmcvd2lraS9NQV9wbG90KSwgdGhpcyBwbG90IHNob3dzIHRoZSBsb2ctZm9sZCBjaGFuZ2UgYWdhaW5zdCBsb2ctY291bnRzIHBlciBtaWxsaW9uLCB3aXRoIERFIGdlbmVzIGhpZ2hsaWdodGVkOgoKYGBge3J9CnN1bW1hcnkoZGUgPC0gZGVjaWRlVGVzdHNER0UobHJ0LkJ2c0wpKQpkZXRhZ3MgPC0gcm93bmFtZXMoZGdlT2JqKVthcy5sb2dpY2FsKGRlKV0KcGxvdFNtZWFyKGxydC5CdnNMLCBkZS50YWdzPWRldGFncykKYGBgCkhvd2V2ZXIsIG9uIHN1Y2ggYSBwbG90IGl0IHdvdWxkIGJlIG5pY2UgdG8gYWRkIGxhYmVscyB0byBoaWdobGlnaHQgdGhlIGdlbmVzIHdpdGggbW9zdCBldmlkZW5jZSBmb3IgYmVpbmcgREUsIG9yIG91ciBmYXZvdXJpdGUgZ2VuZXMuIFRvIHBlcmZvcm0gc3VjaCBhIHRhc2sgd2UgbmVlZCB0byBtYXAgYmV0d2VlbiB0aGUgaWRlbnRpZmllcnMgd2UgaGF2ZSBpbiB0aGUgYGVkZ2VSYCBvdXRwdXQgYW5kIG1vcmUgZmFtaWxpYXIgbmFtZXMuCgpGaW5hbGx5LCB3ZSB3aWxsIGxvb2sgYXQgc29waGlzdGljYXRlZCB2aXN1YWxpc2F0aW9ucyB0aGF0IGFsbG93IHVzIHRvIGluY29ycG9yYXRlIGluZm9ybWF0aW9uIGFib3V0IHRoZSBzdHJ1Y3R1cmUgb2YgYSBnZW5lLCBsZXZlbCBvZiBzZXF1ZW5jaW5nIGNvdmVyYWdlLgoKIyMgQWRkaW5nIGFubm90YXRpb24gdG8gdGhlIGVkZ2VSIHJlc3VsdHMKClRoZXJlIGFyZSBhIG51bWJlciBvZiB3YXlzIHRvIGFkZCBhbm5vdGF0aW9uLCBidXQgd2Ugd2lsbCBkZW1vbnN0cmF0ZSBob3cgdG8gZG8gdGhpcyB1c2luZyB0aGUgKm9yZy5NbS5lZy5kYiogcGFja2FnZS4gVGhpcyBwYWNrYWdlIGlzIG9uZSBvZiBzZXZlcmFsICpvcmdhbmlzbS1sZXZlbCogcGFja2FnZXMgd2hpY2ggYXJlIHJlLWJ1aWx0IGV2ZXJ5IDYgbW9udGhzLiBUaGVzZSBwYWNrYWdlcyBhcmUgbGlzdGVkIG9uIHRoZSBbYW5ub3RhdGlvbiBzZWN0aW9uXShodHRwOi8vYmlvY29uZHVjdG9yLm9yZy9wYWNrYWdlcy9yZWxlYXNlL0Jpb2NWaWV3cy5odG1sI19fX0Fubm90YXRpb25EYXRhKSBvZiB0aGUgQmlvY29uZHVjdG9yLCBhbmQgYXJlIGluc3RhbGxlZCBpbiB0aGUgc2FtZSB3YXkgYXMgcmVndWxhciBCaW9jb25kdWN0b3IgcGFja2FnZXMuIEFuIGFsdGVybmF0aXZlIGFwcHJvYWNoIGlzIHRvIHVzZSBgYmlvbWFSdGAsIGFuIGludGVyZmFjZSB0byB0aGUgW0Jpb01hcnRdKGh0dHA6Ly93d3cuYmlvbWFydC5vcmcvKSByZXNvdXJjZS4gQmlvTWFydCBpcyBtdWNoIG1vcmUgY29tcHJlaGVuc2l2ZSwgYnV0IHRoZSBvcmdhbmlzbSBwYWNrYWdlIGZpdCBiZXR0ZXIgaW50byB0aGUgQmlvY29uZHVjdG9yIHdvcmtmbG93LgoKCmBgYHtyIGV2YWw9RkFMU0V9CnNvdXJjZSgiaHR0cDovL3d3dy5iaW9jb25kdWN0b3Iub3JnL2Jpb2NMaXRlLlIiKQpiaW9jTGl0ZSgib3JnLk1tLmVnLmRiIikKIyBGb3IgSHVtYW4KYmlvY0xpdGUoIm9yZy5Icy5lZy5kYiIpCmBgYAoKVGhlIHBhY2thZ2VzIGFyZSBsYXJnZXIgaW4gc2l6ZSB0aGF0IEJpb2NvbmR1Y3RvciBzb2Z0d2FyZSBwYWNha2dlcywgYnV0IGVzc2VudGlhbGx5IHRoZXkgYXJlIGRhdGFiYXNlcyB0aGF0IGNhbiBiZSB1c2VkIHRvIG1ha2UgKm9mZmxpbmUqIHF1ZXJpZXMuIAoKYGBge3J9CmxpYnJhcnkob3JnLk1tLmVnLmRiKQpgYGAKCgpGaXJzdCB3ZSBuZWVkIHRvIGRlY2lkZSB3aGF0IGluZm9ybWF0aW9uIHdlIHdhbnQuIEluIG9yZGVyIHRvIHNlZSB3aGF0IHdlIGNhbiBleHRyYWN0IHdlIGNhbiBydW4gdGhlIGBjb2x1bW5zYCBmdW5jdGlvbiBvbiB0aGUgYW5ub3RhdGlvbiBkYXRhYmFzZS4KCmBgYHtyfQpjb2x1bW5zKG9yZy5NbS5lZy5kYikKYGBgCgpXZSBhcmUgZ29pbmcgdG8gZmlsdGVyIHRoZSBkYXRhYmFzZSBieSBhIGtleSBvciBzZXQgb2Yga2V5cyBpbiBvcmRlciB0byBleHRyYWN0IHRoZSBpbmZvcm1hdGlvbiB3ZSB3YW50LiBWYWxpZCBuYW1lcyBmb3IgdGhlIGtleSBjYW4gYmUgcmV0cmlldmVkIHdpdGggdGhlIGBrZXl0eXBlc2AgZnVuY3Rpb24uCgpgYGB7cn0Ka2V5dHlwZXMob3JnLk1tLmVnLmRiKQpgYGAKCldlIHNob3VsZCBzZWUgYEVOVFJFWklEYCwgd2hpY2ggaXMgdGhlIHR5cGUgb2Yga2V5IHdlIGFyZSBnb2luZyB0byB1c2UgaW4gdGhpcyBjYXNlLiBJZiB3ZSBhcmUgdW5zdXJlIHdoYXQgdmFsdWVzIGFyZSBhY2NlcHRhYmxlIGZvciB0aGUga2V5LCB3ZSBjYW4gY2hlY2sgd2hhdCBrZXlzIGFyZSB2YWxpZCB3aXRoIGBrZXlzYAoKYGBge3J9CmtleXMob3JnLk1tLmVnLmRiLCBrZXl0eXBlPSJFTlRSRVpJRCIpWzE6MTBdCmBgYAoKSXQgaXMgYSB1c2VmdWwgc2FuaXR5IGNoZWNrIHRvIG1ha2Ugc3VyZSB0aGF0IHRoZSBrZXlzIHlvdSB3YW50IHRvIHVzZSBhcmUgYWxsIHZhbGlkLiBXZSBjb3VsZCB1c2UgYCVpbiVgIGluIHRoaXMgY2FzZS4KCmBgYHtyfQojIyBCdWlsZCB1cCB0aGUgcXVlcnkgc3RlcC1ieS1zdGVwCm15LmtleXMgPC0gYygiNTA5MTYiLCAiMTEwMzA4IiwiMTIyOTMiKQpteS5rZXlzICVpbiUga2V5cyhvcmcuTW0uZWcuZGIsIGtleXR5cGU9IkVOVFJFWklEIikKYWxsKG15LmtleXMgJWluJSBrZXlzKG9yZy5NbS5lZy5kYiwga2V5dHlwZT0iRU5UUkVaSUQiKSkKYGBgCgpMZXQncyBidWlsZCB1cCB0aGUgcXVlcnkgc3RlcCBieSBzdGVwLgoKYGBge3IgZXZhbD1GQUxTRX0KIyMgdG8gYmUgZmlsbGVkLWluIGludGVyYWN0aXZlbHkgZHVyaW5nIHRoZSBjbGFzcy4Kc2VsZWN0KG9yZy5NbS5lZy5kYiwKCgpgYGAKCgoKVG8gYW5ub3RhdGUgb3VyIHJlc3VsdHMsIHdlIGRlZmluaXRlbHkgd2FudCBnZW5lIHN5bWJvbHMgYW5kIHBlcmhhcHMgdGhlIGZ1bGwgZ2VuZSBuYW1lLiBMZXQncyBidWlsZCB1cCBvdXIgYW5ub3RhdGlvbiBpbmZvcm1hdGlvbiBpbiBhIHNlcGFyYXRlIGRhdGEgZnJhbWUgdXNpbmcgdGhlIGBzZWxlY3RgIGZ1bmN0aW9uLgoKYGBge3J9CmFubiA8LSBzZWxlY3Qob3JnLk1tLmVnLmRiLGtleXM9cm93bmFtZXMocmVzdWx0cyksY29sdW1ucz1jKCJFTlRSRVpJRCIsIlNZTUJPTCIsIkdFTkVOQU1FIikpCiMgSGF2ZSBhIGxvb2sgYXQgdGhlIGFubm90YXRpb24KYW5uCgpgYGAKCkxldCdzIGRvdWJsZSBjaGVjayB0aGF0IHRoZSBgRU5UUkVaSURgIGNvbHVtbiBtYXRjaGVzIGV4YWN0bHkgdG8gb3VyIGByZXN1bHRzYCByb3duYW1lcy4KCmBgYHtyfQp0YWJsZShhbm4kRU5UUkVaSUQ9PXJvd25hbWVzKHJlc3VsdHMpKQpgYGAKCldlIGNhbiBiaW5kIGluIHRoZSBhbm5vdGF0aW9uIGluZm9ybWF0aW9uIHRvIHRoZSBgcmVzdWx0c2AgZGF0YSBmcmFtZS4gKFBsZWFzZSBub3RlIHRoYXQgaWYgdGhlIGBzZWxlY3RgIGZ1bmN0aW9uIHJldHVybnMgYSAxOm1hbnkgbWFwcGluZyB0aGVuIHlvdSBjYW4ndCBqdXN0IGFwcGVuZCB0aGUgYW5ub3RhdGlvbiB0byB0aGUgZml0IG9iamVjdC4pCgpgYGB7cn0KcmVzdWx0cy5hbm5vdGF0ZWQgPC0gY2JpbmQocmVzdWx0cywgYW5uKQpyZXN1bHRzLmFubm90YXRlZAoKYGBgCgoKV2UgY2FuIHNhdmUgdGhlIHJlc3VsdHMgdGFibGUgdXNpbmcgdGhlIGB3cml0ZS5jc3ZgIGZ1bmN0aW9uLCB3aGljaCB3cml0ZXMgdGhlIHJlc3VsdHMgb3V0IHRvIGEgY3N2IGZpbGUgdGhhdCB5b3UgY2FuIG9wZW4gaW4gZXhjZWwuCgpgYGB7cn0Kd3JpdGUuY3N2KHJlc3VsdHMuYW5ub3RhdGVkLGZpbGU9IkIuUHJlZ1ZzTGFjUmVzdWx0cy5jc3YiLHJvdy5uYW1lcz1GQUxTRSkKYGBgCgoqKkEgbm90ZSBhYm91dCBkZWNpZGluZyBob3cgbWFueSBnZW5lcyBhcmUgc2lnbmlmaWNhbnQqKjogSW4gb3JkZXIgdG8gZGVjaWRlIHdoaWNoIGdlbmVzIGFyZSBkaWZmZXJlbnRpYWxseSBleHByZXNzZWQsIHdlIHVzdWFsbHkgdGFrZSBhIGN1dC1vZmYgb2YgMC4wNSBvbiB0aGUgYWRqdXN0ZWQgcC12YWx1ZSwgTk9UIHRoZSByYXcgcC12YWx1ZS4gVGhpcyBpcyBiZWNhdXNlIHdlIGFyZSB0ZXN0aW5nIG1vcmUgdGhhbiAxNTAwMCBnZW5lcywgYW5kIHRoZSBjaGFuY2VzIG9mIGZpbmRpbmcgZGlmZmVyZW50aWFsbHkgZXhwcmVzc2VkIGdlbmVzIGlzIHZlcnkgaGlnaCB3aGVuIHlvdSBkbyB0aGF0IG1hbnkgdGVzdHMuIEhlbmNlIHdlIG5lZWQgdG8gY29udHJvbCB0aGUgZmFsc2UgZGlzY292ZXJ5IHJhdGUsIHdoaWNoIGlzIHRoZSBhZGp1c3RlZCBwLXZhbHVlIGNvbHVtbiBpbiB0aGUgcmVzdWx0cyB0YWJsZS4gV2hhdCB0aGlzIG1lYW5zIGlzIHRoYXQgaWYgMTAwIGdlbmVzIGFyZSBzaWduaWZpY2FudCBhdCBhIDVcJSBmYWxzZSBkaXNjb3ZlcnkgcmF0ZSwgd2UgYXJlIHdpbGxpbmcgdG8gYWNjZXB0IHRoYXQgNSB3aWxsIGJlIGZhbHNlIHBvc2l0aXZlcy4gTm90ZSB0aGF0IHRoZSBgZGVjaWRlVGVzdHNgIGZ1bmN0aW9uIGRpc3BsYXlzIHNpZ25pZmljYW50IGdlbmVzIGF0IDVcJSBGRFIuCgo+ICMjIENoYWxsZW5nZSB7LmNoYWxsZW5nZX0KPgo+IFJlLXZpc2l0IHRoZSBgcGxvdFNtZWFyYCBwbG90IGZyb20gYWJvdmUgYW5kIHVzZSB0aGUgYHRleHRgIGZ1bmN0aW9uIHRvIGFkZCBsYWJlbHMgZm9yIHRoZSBuYW1lcyBvZiB0aGUgdG9wIDIwMCBtb3N0IERFIGdlbmVzCj4KCmBgYHtyLGVjaG89RkFMU0UsZmlnLmhlaWdodD01LGZpZy53aWR0aD0xMH0KCnBsb3RTbWVhcihscnQuQnZzTCwgZGUudGFncz1kZXRhZ3MpCgpOIDwtIDIwMAoKdGV4dChyZXN1bHRzLmFubm90YXRlZCRsb2dDUE1bMTpOXSxyZXN1bHRzLmFubm90YXRlZCRsb2dGQ1sxOk5dLGxhYmVscyA9IHJlc3VsdHMuYW5ub3RhdGVkJFNZTUJPTFsxOk5dLGNvbD0iYmx1ZSIpCmBgYAoKCkFub3RoZXIgY29tbW9uIHZpc3VhbGlzYXRpb24gaXMgdGhlIFsqdm9sY2FubyBwbG90Kl0oaHR0cHM6Ly9lbi53aWtpcGVkaWEub3JnL3dpa2kvVm9sY2Fub19wbG90XyhzdGF0aXN0aWNzKSkgd2hpY2ggZGlzcGxheSBhIG1lYXN1cmUgb2Ygc2lnbmlmaWNhbmNlIG9uIHRoZSB5LWF4aXMgYW5kIGZvbGQtY2hhbmdlIG9uIHRoZSB4LWF4aXMuIAoKYGBge3IsZmlnLmhlaWdodD01LGZpZy53aWR0aD0xMH0Kc2lnbmlmIDwtIC1sb2cxMChyZXN1bHRzLmFubm90YXRlZCRGRFIpCnBsb3QocmVzdWx0cy5hbm5vdGF0ZWQkbG9nRkMsc2lnbmlmLHBjaD0xNikKcG9pbnRzKHJlc3VsdHMuYW5ub3RhdGVkW2RldGFncywibG9nRkMiXSwtbG9nMTAocmVzdWx0cy5hbm5vdGF0ZWRbZGV0YWdzLCJGRFIiXSkscGNoPTE2LGNvbD0icmVkIikKCmBgYAoKCkJlZm9yZSBmb2xsb3dpbmcgdXAgb24gdGhlIERFIGdlbmVzIHdpdGggZnVydGhlciBsYWIgd29yaywgYSByZWNvbW1lbmRlZCAqc2FuaXR5IGNoZWNrKiBpcyB0byBoYXZlIGEgbG9vayBhdCB0aGUgZXhwcmVzc2lvbiBsZXZlbHMgb2YgdGhlIGluZGl2aWR1YWwgc2FtcGxlcyBmb3IgdGhlIGdlbmVzIG9mIGludGVyZXN0LiBXZSBjYW4gcXVpY2tseSBsb29rIGF0IGdyb3VwZWQgZXhwcmVzc2lvbiB1c2luZyBgc3RyaXBjaGFydGAuIFdlIGNhbiB1c2UgdGhlIG5vcm1hbGlzZWQgbG9nIGV4cHJlc3Npb24gdmFsdWVzIGluIHRoZSAgYGRnZUNvdW50c2Agb2JqZWN0IChgZGdlQ291bnRzJGNvdW50c2ApLgoKYGBge3IsZmlnLndpZHRoPTEyLGZpZy5oZWlnaHQ9NX0KbGlicmFyeShSQ29sb3JCcmV3ZXIpCnBhcihtZnJvdz1jKDEsMykpCm5vcm1Db3VudHMgPC0gZGdlT2JqJGNvdW50cwojIExldCdzIGxvb2sgYXQgdGhlIGZpcnN0IGdlbmUgaW4gdGhlIHRvcFRhYmxlLCBLcnQ1LCB3aGljaCBoYXMgYSByb3duYW1lIDUwOTE2CnN0cmlwY2hhcnQobm9ybUNvdW50c1siMTEwMzA4Iixdfmdyb3VwKQojIFRoaXMgcGxvdCBpcyB1Z2x5LCBsZXQncyBtYWtlIGl0IGJldHRlcgpzdHJpcGNoYXJ0KG5vcm1Db3VudHNbIjExMDMwOCIsXX5ncm91cCx2ZXJ0aWNhbD1UUlVFLGxhcz0yLGNleC5heGlzPTAuOCxwY2g9MTYsY29sPTE6NixtZXRob2Q9ImppdHRlciIpCiMgTGV0J3MgdXNlIG5pY2VyIGNvbG91cnMKbmljZS5jb2wgPC0gYnJld2VyLnBhbCg2LG5hbWU9IkRhcmsyIikKc3RyaXBjaGFydChub3JtQ291bnRzWyIxMTAzMDgiLF1+Z3JvdXAsdmVydGljYWw9VFJVRSxsYXM9MixjZXguYXhpcz0wLjgscGNoPTE2LGNleD0xLjMsY29sPW5pY2UuY29sLG1ldGhvZD0iaml0dGVyIix5bGFiPSJOb3JtYWxpc2VkIGxvZzIgZXhwcmVzc2lvbiIsbWFpbj0iCUtydDUiKQpgYGAKCkFuIGludGVyYWN0aXZlIHZlcnNpb24gb2YgdGhlIHZvbGNhbm8gcGxvdCBhYm92ZSB0aGF0IGluY2x1ZGVzIHRoZSByYXcgcGVyIHNhbXBsZSB2YWx1ZXMgaW4gYSBzZXBhcmF0ZSBwYW5lbCBpcyBwb3NzaWJsZSB2aWEgdGhlIGBnbFhZUGxvdGAgZnVuY3Rpb24gaW4gdGhlICpHbGltbWEqIHBhY2thZ2UuCgoKYGBge3J9CmxpYnJhcnkoR2xpbW1hKQpncm91cDIgPC0gZ3JvdXAKbGV2ZWxzKGdyb3VwMikgPC0gYygiYmFzYWwubGFjdGF0ZSIsImJhc2FsLnByZWciLCJiYXNhbC52aXJnaW4iLCJsdW0ubGFjdGF0ZSIsICJsdW0ucHJlZyIsICJsdW0udmlyZ2luIikKZ2xYWVBsb3QoeD1yZXN1bHRzJGxvZ0ZDLCB5PS1sb2cxMChyZXN1bHRzJEZEUiksCiAgICAgICAgIHhsYWI9ImxvZ0ZDIiwgeWxhYj0iQiIsIG1haW49IkIuUHJlZ1ZzTGFjIiwKICAgICAgICAgY291bnRzPW5vcm1Db3VudHMsIGdyb3Vwcz1ncm91cDIsIHN0YXR1cz1kZSwKICAgICAgICAgYW5ubz1hbm4sIGlkLmNvbHVtbj0iRU5UUkVaSUQiLCBmb2xkZXI9InZvbGNhbm8iKQpgYGAKCgpUaGlzIGZ1bmN0aW9uIGNyZWF0ZXMgYW4gaHRtbCBwYWdlICguL3ZvbGNhbm8vWFktUGxvdC5odG1sKSB3aXRoIGEgdm9sY2FubyBwbG90IG9uIHRoZSBsZWZ0IGFuZCBhIHBsb3Qgc2hvd2luZyB0aGUgbG9nLUNQTSBwZXIgc2FtcGxlIGZvciBhIHNlbGVjdGVkIGdlbmUgb24gdGhlIHJpZ2h0LiBBIHNlYXJjaCBiYXIgaXMgYXZhaWxhYmxlIHRvIHNlYXJjaCBmb3IgZ2VuZXMgb2YgaW50ZXJlc3QuCgoKCiMjIFJldHJpZXZpbmcgR2Vub21pYyBMb2NhdGlvbnMKCgpJdCBtaWdodCBzZWVtIG5hdHVyYWwgdG8gYWRkIGdlbm9taWMgbG9jYXRpb25zIHRvIG91ciBhbm5vdGF0aW9uIHRhYmxlLCBhbmQgcG9zc2libHkgYSBiaXQgb2RkIHRoYXQgdGhlIGBvcmcuTW0uZWcuZGJgIHBhY2thZ2UgZG9lcyBub3Qgc3VwcGx5IHN1Y2ggbWFwcGluZ3MuIEluIGZhY3QsIHRoZXJlIGlzIGEgd2hvbGUgc3VpdGUgb2YgcGFja2FnZSBmb3IgcGVyZm9ybWluZyB0aGlzLCBhbmQgbW9yZS1hZHZhbmNlZCBxdWVyaWVzLiBUaGVzZSBhcmUgbGlzdGVkIG9uIHRoZSBCaW9jb25kdWN0b3IgW2Fubm90YXRpb24gcGFnZV0oaHR0cDovL2Jpb2NvbmR1Y3Rvci5vcmcvcGFja2FnZXMvcmVsZWFzZS9CaW9jVmlld3MuaHRtbCNfX19Bbm5vdGF0aW9uRGF0YSkgYW5kIGhhdmUgdGhlIHByZWZpeCBgVHhEYi5gCgpUaGUgcGFja2FnZSB3ZSB3aWxsIGJlIHVzaW5nIGlzIGBUeERiLk1tdXNjdWx1cy5VQ1NDLm1tMTAua25vd25HZW5lYC4gUGFja2FnZXMgYXJlIGF2YWlsYWJsZSBmb3Igb3RoZXIgb3JnYW5pc21zIGFuZCBnZW5vbWUgYnVpbGRzLiBJdCBpcyBldmVuIHBvc3NpYmxlIHRvICpidWlsZCB5b3VyIG93biBkYXRhYmFzZSogaWYgb25lIGRvZXMgbm90IGV4aXN0LiBTZWUgYHZpZ25ldHRlKCJHZW5vbWljRmVhdHVyZXMiKWAgZm9yIGRldGFpbHMKCmBgYHtyIGV2YWw9RkFMU0V9CnNvdXJjZSgiaHR0cDovL3d3dy5iaW9jb25kdWN0b3Iub3JnL2Jpb2NMaXRlLlIiKQpiaW9jTGl0ZSgiVHhEYi5NbXVzY3VsdXMuVUNTQy5tbTEwLmtub3duR2VuZSIpCgojIyBGb3IgSHVtYW5zCmJpb2NMaXRlKCJUeERiLkhzYXBpZW5zLlVDU0MuaGcxOS5rbm93bkdlbmUiKQoKYGBgCgpXZSBsb2FkIHRoZSBsaWJyYXJ5IGluIHRoZSB1c3VhbCBmYXNoaW9uIGFuZCBjcmVhdGUgYSBuZXcgb2JqZWN0IHRvIHNhdmUgc29tZSB0eXBpbmcuIEFzIHdpdGggdGhlIGBvcmcuYCBwYWNrYWdlcywgd2UgY2FuIHF1ZXJ5IHdoYXQgY29sdW1ucyBhcmUgYXZhaWxhYmxlIHdpdGggYGNvbHVtbnNgLAoKYGBge3J9CmxpYnJhcnkoVHhEYi5NbXVzY3VsdXMuVUNTQy5tbTEwLmtub3duR2VuZSkKdHggPC0gVHhEYi5NbXVzY3VsdXMuVUNTQy5tbTEwLmtub3duR2VuZQpjb2x1bW5zKHR4KQpgYGAKClRoZSBgc2VsZWN0YCBmdW5jdGlvbiBpcyB1c2VkIGluIHRoZSBzYW1lIG1hbm5lciBhcyB0aGUgYG9yZy5NbS5lZy5kYmAgcGFja2FnZXMuIAoKCj4gIyMgQ2hhbGxlbmdlIHsuY2hhbGxlbmdlfQo+Cj4gVXNlIHRoZSBUeERiLk1tdXNjdWx1cy5VQ1NDLm1tMTAua25vd25HZW5lIHBhY2thZ2UgdG8gcmV0cmlldmUgdGhlIGV4b24gY29vcmRpbmF0ZXMgZm9yIHRoZSBnZW5lcyBgNTA5MTZgLCBgMTEwMzA4YCwgYDEyMjkzYCAKPgoKYGBge3IgZWNobz1GQUxTRSx3YXJuaW5nPUZBTFNFLG1lc3NhZ2U9RkFMU0V9CmtleXMgPC0gYygiNTA5MTYiLCIxMTAzMDgiLCIxMjI5MyIpCnNlbGVjdCh0eCwga2V5cz1rZXlzLAogICAgICAga2V5dHlwZSA9ICJHRU5FSUQiLAogICAgICAgY29sdW1ucz1jKCJFWE9OQ0hST00iLCJFWE9OU1RBUlQiLCJFWE9ORU5EIikKICAgICAgKQoKYGBgCgojIyMgT3ZlcnZpZXcgb2YgR2Vub21pY1JhbmdlcwoKT25lIG9mIHRoZSByZWFsIHN0cmVuZ3RocyBvZiB0aGUgYHR4ZGIuLmAgcGFja2FnZXMgaXMgdGhlIGFiaWxpdHkgb2YgaW50ZXJmYWNlIHdpdGggYEdlbm9taWNSYW5nZXNgLCB3aGljaCBpcyB0aGUgb2JqZWN0IHR5cGUgdXNlZCB0aHJvdWdob3V0IEJpb2NvbmR1Y3RvciBbdG8gbWFuaXB1bGF0ZSBHZW5vbWljIEludGVydmFsc10oaHR0cHM6Ly93d3cubmNiaS5ubG0ubmloLmdvdi9wbWMvYXJ0aWNsZXMvUE1DMzczODQ1OC9wZGYvcGNiaS4xMDAzMTE4LnBkZikuIAoKVGhlc2Ugb2JqZWN0IHR5cGVzIHBlcm1pdCB1cyB0byBwZXJmb3JtIGNvbW1vbiBvcGVyYXRpb25zIG9uIGludGVydmFscyBzdWNoIGFzIG92ZXJsYXBwaW5nIGFuZCBjb3VudGluZy4KYGBge3J9CmxpYnJhcnkoR2Vub21pY1JhbmdlcykKbXkucmFuZ2UgPC1HUmFuZ2VzKCJjaHIxIiwgSVJhbmdlcyhzdGFydD0xMDAwLGVuZD0yMDAwKSkKbXkucmFuZ2UKCmBgYAoKTGV0J3MgdHJ5IHNvbWUgZHVtbXkgaW50ZXJ2YWxzIHdpdGggcmFuZG9tIGNocm9tc29tZSBhc3NpZ25tZW50cyBhbmQgc3RhcnQgcG9zaXRpb25zLiAKYGBge3J9CnNldC5zZWVkKDA1MDUyMDE3KQpjaHJzIDwtIHNhbXBsZShwYXN0ZTAoImNociIsMToxOSksMTAwLHJlcGxhY2U9VFJVRSkKc3RhcnRQb3MgPC0gc2FtcGxlKDE6NWU2LDEwMCxyZXBsYWNlPVRSVUUpCm15LnJhbmdlc0EgPC0gR1JhbmdlcyhjaHJzLCBJUmFuZ2VzKHN0YXJ0PXN0YXJ0UG9zLHdpZHRoPTEwMDApKQpteS5yYW5nZXNBCgpgYGAKClRoZXJlIGFyZSBhIG51bWJlciBvZiB1c2VmdWwgZnVuY3Rpb25zIGZvciBjYWxjdWxhdGluZyBwcm9wZXJ0aWVzIG9mIHRoZSBkYXRhIChzdWNoIGFzICpjb3ZlcmFnZSogb3Igc29ydGluZykuIEl0IGlzIGV2ZW4gcG9zc2libGUgdG8gY29udmVydCBiZXR3ZWVuIGRpZmZlcmVudCBjaHJvbW9zb21lIG5hbWluZyBjb252ZW50aW9ucy4KCmBgYHtyfQp3aWR0aChteS5yYW5nZXNBKQpzb3J0KG15LnJhbmdlc0EpCmNvdmVyYWdlKG15LnJhbmdlc0EpCnNlcWxldmVsc1N0eWxlKG15LnJhbmdlc0EpCmtlZXBTZXFsZXZlbHMobXkucmFuZ2VzQSwiY2hyMTkiKQojc2VxbGV2ZWxzU3R5bGUobXkucmFuZ2VzQSkgPC0gIkVuc2VtYmwiCiNteS5yYW5nZXNBCmBgYAoKCmBgYHtyfQpteS5yYW5nZXNCIDwtIHNoaWZ0KG15LnJhbmdlc0EsIHNoaWZ0ID0gNTAwKQpteS5yYW5nZXNCIDwtIHJlc2l6ZShteS5yYW5nZXNCLHdpZHRoID1zYW1wbGUoMToxMDAwLDEwMCxyZXBsYWNlID0gVFJVRSkpCm15LnJhbmdlc0IKYGBgCgpgYGB7cn0KZmluZE92ZXJsYXBzKG15LnJhbmdlc0EsbXkucmFuZ2VzQikKYGBgCgojIyBSZXRyaWV2aW5nIEdlbmUgQ29vcmRpbmF0ZXMgYXMgR2Vub21pY1JhbmdlcwoKSXQgaXMgcXVpdGUgc3RyYWlnaHRmb3J3YXJkIHRvIHRyYW5zbGF0ZSB0aGUgb3V0cHV0IG9mIGEgYHNlbGVjdGAgcXVlcnkgaW50byBhIGBHZW5vbWljRmVhdHVyZXNgIG9iamVjdC4gSG93ZXZlciwgc2V2ZXJhbCBjb252ZW5pZW5jZSBmdW5jdGlvbnMgZXhpc3QgdG8gcmV0cmlldmUgdGhlIHN0cnVjdHVyZSBvZiBldmVyeSBnZW5lIGZvciBhIGdpdmVuIG9yZ2FuaXNtIGluIG9uZSBvYmplY3QuIAoKVGhlIG91dHB1dCBvZiBgZXhvbnNCeWAgaXMgYSBsaXN0LCB3aGVyZSBlYWNoIGl0ZW0gaW4gdGhlIGxpc3QgaXMgdGhlIGV4b24gY28tb3JkaW5hdGVzIG9mIGEgcGFydGljdWxhciBnZW5lLiAKCmBgYHtyfQpleG8gPC0gZXhvbnNCeSh0eCwiZ2VuZSIpCmV4bwpgYGAKClRvIGFjY2VzcyB0aGUgc3RydWN0dXJlIG9mIGEgcGFydGljdWxhciBnZW5lLCB3ZSBjYW4gdXNlIHRoZSBgW1tgIHN5bnRheCB3aXRoIHRoZSBuYW1lIG9mIHRoZSBnZW5lIChFbnRyZXogZ2VuZSBJRCkgd2l0aGluIHF1b3RlIG1hcmtzLgoKYGBge3J9CmV4b1tbIjEyOTkyIl1dCmBgYAoKCiMjIEV4cG9ydGluZyB0cmFja3MKCkl0IGlzIGFsc28gcG9zc2libGUgdG8gc2F2ZSB0aGUgcmVzdWx0cyBvZiBhIEJpb2NvbmR1Y3RvciBhbmFseXNpcyBpbiBhIGJyb3dzZXIgdG8gZW5hYmxlIGludGVyYWN0aXZlIGFuYWx5c2lzIGFuZCBpbnRlZ3JhdGlvbiB3aXRoIG90aGVyIGRhdGEgdHlwZXMsIG9yIHNoYXJpbmcgd2l0aCBjb2xsYWJvcmF0b3JzLiBGb3IgaW5zdGFuY2UsIHdlIG1pZ2h0IHdhbnQgYSBicm93c2VyIHRyYWNrIHRvIGluZGljYXRlIHdoZXJlIG91ciBkaWZmZXJlbnRpYWxseS1leHByZXNzZWQgZ2VuZXMgYXJlIGxvY2F0ZWQuIFdlIHNoYWxsIHVzZSB0aGUgYGJlZGAgZm9ybWF0IHRvIGRpc3BsYXkgdGhlc2UgbG9jYXRpb25zLiBXZSB3aWxsIGFubm90YXRlIHRoZSByYW5nZXMgd2l0aCBpbmZvcm1hdGlvbiBmcm9tIG91ciBhbmFseXNpcyBzdWNoIGFzIHRoZSBmb2xkLWNoYW5nZSBhbmQgc2lnbmlmaWNhbmNlLgoKRmlyc3Qgd2UgY3JlYXRlIGEgZGF0YSBmcmFtZSBmb3IganVzdCB0aGUgREUgZ2VuZXMuCmBgYHtyfQpzaWdHZW5lcyA8LSByZXN1bHRzLmFubm90YXRlZFtkZXRhZ3MsXQpzaWdHZW5lcwpgYGAKCkF0IHRoZSBtb21lbnQsIHdlIGhhdmUgYSBHZW5vbWljRmVhdHVyZXMgb2JqZWN0IHRoYXQgcmVwcmVzZW50cyBldmVyeSBleG9uLiBIb3dldmVyLCB3ZSBkbyBub3QKbmVlZCB0aGlzIGxldmVsIG9mIGdyYW51bGFyaXR5IGZvciB0aGUgYmVkIG91dHB1dCwgc28gd2Ugd2lsbCBjb2xsYXBzZSB0byBhIHNpbmdsZSByZWdpb24gZm9yIGVhY2ggZ2VuZS4gRmlyc3Qgd2UgdGhlIGByYW5nZWAgZnVuY3Rpb24gdG8gb2J0YWluIGEgc2luZ2xlIHJhbmdlIGZvciBldmVyeSBnZW5lIGFuZCB0cmFuZm9ybSB0byBhIG1vcmUgY29udmVuaWVudCBvYmplY3Qgd2l0aCBgdW5saXN0YC4KYGBge3J9CnJhbmdlKGV4bykKZXhvUmFuZ2VzIDwtIHVubGlzdChyYW5nZShleG8pKQpzaWdSZWdpb25zIDwtIGV4b1Jhbmdlc1tuYS5vbWl0KG1hdGNoKHNpZ0dlbmVzJEVOVFJFWklELCBuYW1lcyhleG9SYW5nZXMpKSldCnNpZ1JlZ2lvbnMKYGBgCgpSYXRoZXIgdGhhbiBqdXN0IHJlcHJlc2VudGluZyB0aGUgZ2Vub21pYyBsb2NhdGlvbnMsIHRoZSAuYmVkIGZvcm1hdCBpcyBhbHNvIGFibGUgdG8gY29sb3VyIGVhY2ggcmFuZ2UKYWNjb3JkaW5nIHRvIHNvbWUgcHJvcGVydHkgb2YgdGhlIGFuYWx5c2lzIChlLmcuIGRpcmVjdGlvbiBhbmQgbWFnbml0dWRlIG9mIGNoYW5nZSkgdG8gaGVscCBoaWdobGlnaHQKcGFydGljdWxhciByZWdpb25zIG9mIGludGVyZXN0LiBBIHNjb3JlIGNhbiBhbHNvIGJlIGRpc3BsYXllZCB3aGVuIGEgcGFydGljdWxhciByZWdpb24gaXMgY2xpY2tlZC1vbi4KQSB1c2VmdWwgcHJvcGVyeSBvZiBHZW5vbWljUmFuZ2VzIGlzIHRoYXQgd2UgY2FuIGF0dGFjaCAqbWV0YWRhdGEqIHRvIGVhY2ggcmFuZ2UgdXNpbmcgdGhlIGBtY29sc2AKZnVuY3Rpb24uIFRoZSBtZXRhZGF0YSBjYW4gYmUgc3VwcGxpZWQgaW4gdGhlIGZvcm0gb2YgYSBkYXRhIGZyYW1lLgoKYGBge3J9CnNpZ1JlZ2lvbnMKbWNvbHMoc2lnUmVnaW9ucykgPC0gc2lnR2VuZXNbbWF0Y2gobmFtZXMoc2lnUmVnaW9ucyksIHJvd25hbWVzKHNpZ0dlbmVzKSksXQpzaWdSZWdpb25zCmBgYAoKVGhlIG1ldGFkYXRhIHdlIGhhdmUgYWRkZWQgY2FuIGFsc28gYnkgdXNlZCBhcyBhIG1lYW5zIHRvIGludGVycm9nYXRlIHRoZSByYW5nZXM7IGFzIGlmIHRoZSBkYXRhIHdlcmUgY29udGFpbmVkIGluIGEgZGF0YSBmcmFtZS4KCmBgYHtyfQpzaWdSZWdpb25zW29yZGVyKHNpZ1JlZ2lvbnMkTFIsZGVjcmVhc2luZyA9IFRSVUUpXQpgYGAKCkZvciB2aXN1YWxpc2F0aW9uIHB1cnBvc2VzLCB3ZSBhcmUgZ29pbmcgdG8gcmVzdHJpY3QgdGhlIGRhdGEgdG8gZ2VuZXMgdGhhdCBhcmUgbG9jYXRlZCBvbiBjaHJvbW9zb21lcyAxIHRvIDE5IGFuZCB0aGUgc2V4IGNocm9tb3NvbWVzLiBUaGlzIGNhbiBiZSBkb25lIHdpdGggdGhlIGBrZWVwU2VxTGV2ZWxzYCBmdW5jdGlvbi4KCmBgYHtyfQpzZXFsZXZlbHMoc2lnUmVnaW9ucykKc2lnUmVnaW9ucyA8LSBrZWVwU2VxbGV2ZWxzKHNpZ1JlZ2lvbnMsIHBhc3RlMCgiY2hyIiwgYygxOjE5LCJYIiwiWSIpKSkKYGBgCgpXZSB3aWxsIG5vdyBjcmVhdGUgYSBzY29yZSBmcm9tIHRoZSBwLXZhbHVlcyB0aGF0IHdpbGwgZGlzcGxheWVkIHVuZGVyIGVhY2ggcmVnaW9uLCBhbmQgY29sb3VyIHNjaGVtZQpmb3IgdGhlIHJlZ2lvbnMgYmFzZWQgb24gdGhlIGZvbGQtY2hhbmdlLiBGb3IgdGhlIHNjb3JlIHdlIGNhbiB1c2UgdGhlICQtbG9nX3sxMH0kIG9mIHRoZSBhZGp1c3RlZCBwLXZhbHVlIGFzIGJlZm9yZQoKCgpgYGB7cn0KU2NvcmUgPC0gLWxvZzEwKHNpZ1JlZ2lvbnMkRkRSKQpgYGAKCmBjb2xvclJhbXBQYWxldHRlYCBpcyBhIHVzZWZ1bCBmdW5jdGlvbiBpbiBiYXNlIFIgZm9yIGNvbnN0cnVjdGluZyBhIHBhbGV0dGUgYmV0d2VlbiB0d28gZXh0cmVtZXMuICoqV2hlbiBjaG9vc2luZyBjb2xvdXIgcGFsZXR0ZXMsIG1ha2Ugc3VyZSB0aGV5IGFyZSBjb2xvdXIgYmxpbmQgZnJpZW5kbHkqKi4gVGhlIHJlZCAvIGdyZWVuIGNvbG91ciBzY2hlbWUgdHJhZGl0aW9uYWxseS1hcHBsaWVkIHRvIG1pY3JvYXJyYXlzIGlzIGEgKioqYmFkKioqIGNob2ljZS4KCldlIHdpbGwgYWxzbyB0cnVuY2F0ZSB0aGUgZm9sZC1jaGFuZ2VzIHRvIGJldHdlZW4gLTUgYW5kIDUgdG8gYW5kIGRpdmlkZSB0aGlzIHJhbmdlIGludG8gMTAgZXF1YWwgYmlucwoKYGBge3J9CnJiUGFsIDwtY29sb3JSYW1wUGFsZXR0ZShjKCJyZWQiLCAiYmx1ZSIpKQpsb2dmYyA8LSBwbWF4KHNpZ1JlZ2lvbnMkbG9nRkMsIC01KQpsb2dmYyA8LSBwbWluKGxvZ2ZjICwgNSkKCkNvbCA8LSByYlBhbCgxMClbYXMubnVtZXJpYyhjdXQobG9nZmMsIGJyZWFrcyA9IDEwKSldCmBgYAoKVGhlIGNvbG91cnMgYW5kIHNjb3JlIGhhdmUgdG8gYmUgc2F2ZWQgaW4gdGhlIEdSYW5nZXMgb2JqZWN0IGFzIGBzY29yZWAgYW5kIGBpdGVtUmdiYCBjb2x1bW5zIHJlc3BlY3RpdmVseSwgYW5kIHdpbGwgYmUgdXNlZCB0byBjb25zdHJ1Y3QgdGhlIGJyb3dzZXIgdHJhY2suIFRoZSBydHJhY2tsYXllciBwYWNrYWdlIGNhbiBiZSB1c2VkIHRvIGltcG9ydCBhbmQgZXhwb3J0IGJyb3dzZXJzIHRyYWNrcy4KCk5vdyB3ZSBjYW4gZXhwb3J0IHRoZSBzaWduaWZjYW50IHJlc3VsdHMgZnJvbSB0aGUgREUgYW5hbHlzaXMgYXMgYSBgLmJlZGAgdHJhY2sgdXNpbmcgYHJ0cmFja2xheWVyYC4gWW91IGNhbiBsb2FkIHRoZSByZXN1bHRpbmcgZmlsZSBpbiBJR1YsIGlmIHlvdSB3aXNoLgpgYGB7cn0KbWNvbHMoc2lnUmVnaW9ucykkc2NvcmUgPC0gU2NvcmUKbWNvbHMoc2lnUmVnaW9ucykkaXRlbVJnYiA8LSBDb2wKc2lnUmVnaW9ucwpsaWJyYXJ5KHJ0cmFja2xheWVyKQpleHBvcnQoc2lnUmVnaW9ucyAsIGNvbiA9ICJ0b3BIaXRzLmJlZCIpCmBgYAoKIyMgRXh0cmFjdGluZyBSZWFkcwoKQXMgd2UgaGF2ZSBiZWVuIHVzaW5nIGNvdW50cyBhcyBvdXIgc3RhcnRpbmcgcG9pbnQsIHdlIGhhdmVuJ3QgaW52ZXN0aWdhdGVkIHRoZSBhbGlnbmVkIHJlYWRzIGZyb20gb3VyIGV4cGVyaW1lbnQsIGFuZCBob3cgdGhleSBhcmUgcmVwcmVzZW50ZWQuIEFzIHlvdSBtYXkgYmUgYXdhcmUsIGFsaWduZWQgcmVhZHMgYXJlIHVzdWFsbHkgc3RvcmVkIGluIGEgKmJhbSogZmlsZSB0aGF0IGNhbiBiZSBtYW5pcHVsYXRlZCB3aXRoIG9wZW4tc291cmNlIGNvbW1hbmQtbGluZSB0b29scyBzdWNoIGFzIFsqc2FtdG9vbHMqXShodHRwOi8vd3d3Lmh0c2xpYi5vcmcvKSBhbmQgWypwaWNhcmQqXShodHRwczovL2Jyb2FkaW5zdGl0dXRlLmdpdGh1Yi5pby9waWNhcmQvKS4gQmlvY29uZHVjdG9yIHByb3ZpZGUgYSBsb3ctbGV2ZWwgaW50ZXJmYWNlIHRvIGJhbS9zYW0gZmlsZXMgaW4gdGhlIGZvcm0gb2YgdGhlIGBSc2FtdG9vbHNgIHBhY2thZ2UuIFRoZSBgR2Vub21pY0FsaWdubWVudHNgIHBhY2thZ2UgY2FuIGFsc28gYmUgdXNlZCB0byByZXRyaWV2ZSB0aGUgcmVhZHMgbWFwcGluZyB0byBhIHBhcnRpY3VsYXIgZ2Vub21pYyByZWdpb24gaW4gYW4gZWZmaWNpZW50IG1hbm5lci4KCmBgYHtyfQpsaWJyYXJ5KEdlbm9taWNBbGlnbm1lbnRzKQpgYGAKCmBgYHtyIGV2YWw9RkFMU0V9CmdlbmVyZWdpb24gPC0gZXhvW1siNTA5MTYiXV0KZ2V0d2QoKQpiYW0gPC0gcmVhZEdBbGlnbm1lbnRzKGZpbGU9ImJhbS9NQ0wxLkRHLmJhbSIsCiAgICAgICAgICAgICAgICAgICAgICAgcGFyYW09U2NhbkJhbVBhcmFtKHdoaWNoPWdlbmVyZWdpb24pKQpiYW0KYGBgCgpUaGVyZSBhcmUgdmFyaW91cyB2aXN1YWxpc2F0aW9uIG9wdGlvbnMgZm9yIGFsaWduZWQgcmVhZHMgYW5kIHJhbmdlIGRhdGEuIFdlIHdpbGwgdXNlIHRoZSBgZ2diaW9gIHBhY2thZ2UsIHdoaWNoIGZpcnN0IHJlcXVpcmVzIHNvbWUgZGlzY3Vzc2lvbiBvZiB0aGUgYGdncGxvdDJgIHBsb3R0aW5nIHBhY2thZ2UuCgoKIyMgQnJpZWYgSW50cm9kdWN0aW9uIHRvIGdncGxvdDIKClRoZSBbYGdncGxvdDJgXShodHRwOi8vZ2dwbG90Mi50aWR5dmVyc2Uub3JnLykgcGFja2FnZSBoYXMgZW1lcmdlZCBhcyBhbiBhdHRyYWN0aXZlIGFsdGVybmF0aXZlIHRvIHRoZSB0cmFkaXRpb25hbCBwbG90cyBwcm92aWRlZCBieSBiYXNlIFIuIEEgZnVsbCBvdmVydmlldyBvZiBhbGwgY2FwYWJpbGl0aWVzIG9mIHRoZSBwYWNrYWdlIGlzIGF2YWlsYWJsZSBmcm9tIHRoZSBbY2hlYXRzaGVldF0oaHR0cHM6Ly93d3cucnN0dWRpby5jb20vd3AtY29udGVudC91cGxvYWRzLzIwMTUvMDMvZ2dwbG90Mi1jaGVhdHNoZWV0LnBkZikuCgpBIHNpbXBsZSBzY2F0dGVyIHBsb3QsIGVxdWl2YWxlbnQgdG8gYHBsb3RTbWVhcmAgZnJvbSBiZWZvcmUsIGNhbiBiZSBnZW5lcmF0ZWQgYXMgZm9sbG93czotCgpgYGB7cn0KbGlicmFyeShnZ3Bsb3QyKQpnZ3Bsb3QocmVzdWx0cywgYWVzKHggPSBsb2dDUE0sIHk9bG9nRkMpKSArIGdlb21fcG9pbnQoKSAKCmBgYAoKSW4gYnJpZWY6LQoKLSBgcmVzdWx0c2AgaXMgb3VyIGRhdGEgZnJhbWUgY29udGFpbmluZyB0aGUgdmFyaWFibGVzIHdlIHdpc2ggdG8gcGxvdAotIGBhZXNgIGNyZWF0ZXMgYSBtcHBpbmcgYmV0d2VlbiB0aGUgdmFyaWFibGVzIGluIG91ciBkYXRhIGZyYW1lIHRvIHRoZSAqYWVzKnRoZXRpYyBwcm9wcnRpZXMgb2YgdGhlIHBsb3QKICAgICsgdGhlIHgtYXhpcyBpcyBtYXBwZWQgdG8gYGxvZ0NQTWAsIHktYXhpcyBpcyBtYXBwZWQgdG8gYGxvZ0ZDYAotIGBnZW9tX3BvaW50YCBzcGVjaWZpZXMgdGhlIHBhcnRpY3VsYXIgdHlwZSBvZiBwbG90IHdlIHdhbnQgKGluIHRoaXMgY2FzZSBhIHNjYXR0ZXIgcGxvdCkKICAgICsgc2VlIFt0aGUgY2hlYXRzaGVldF0oaHR0cHM6Ly93d3cucnN0dWRpby5jb20vd3AtY29udGVudC91cGxvYWRzLzIwMTUvMDMvZ2dwbG90Mi1jaGVhdHNoZWV0LnBkZikgZm9yIG90aGVyIHBsb3QgdHlwZXMKClRoZSByZWFsIGFkdmFudGFnZSBvZiBgZ2dwbG90MmAgaXMgdGhlIGFiaWxpdHkgdG8gY2hhbmdlIHRoZSBhcHBlYXJhbmNlIG9mIG91ciBwbG90IGJ5IG1hcHBpbmcgb3RoZXIgdmFyaWFibGVzIHRvIGFzcGVjdHMgb2YgdGhlIHBsb3QuIEZvciBleGFtcGxlLCB3ZSBjb3VsZCBjb2xvdXIgdGhlIHBvaW50cyBiYXNlZCBvbiBhIHAtdmFsdWUgY3V0LW9mZi4gVGhlIGNvbG91cnMgYXJlIGF1dG9tYXRpY2FsbHkgY2hvc2VuIGJ5IGBnZ3Bsb3QyYCwgYnV0IHdlIGNhbiBzcGVjaWZpeSBwYXJ0aWN1bGFyIHZhbHVlcy4KCmBgYHtyfQpnZ3Bsb3QocmVzdWx0cywgYWVzKHggPSBsb2dDUE0sIHk9bG9nRkMsY29sPUZEUiA8IDAuMDUpKSArIGdlb21fcG9pbnQoKQoKZ2dwbG90KHJlc3VsdHMsIGFlcyh4ID0gbG9nQ1BNLCB5PWxvZ0ZDLGNvbD1GRFIgPCAwLjA1KSkgKyBnZW9tX3BvaW50KGFscGhhPTAuNCkgKyBzY2FsZV9jb2xvdXJfbWFudWFsKHZhbHVlcz1jKCJibGFjayIsInJlZCIpKQpgYGAKCmBgYHtyfQpnZ3Bsb3QocmVzdWx0cywgYWVzKHggPSBsb2dDUE0sIHk9bG9nRkMsY29sPUZEUiA8IDAuMDUpKSArIGdlb21fcG9pbnQoKSArIHNjYWxlX2NvbG91cl9tYW51YWwodmFsdWVzPWMoImJsYWNrIiwicmVkIikpCmBgYAoKVGhlIHZvbGNhbm8gcGxvdCBjYW4gYmUgY29uc3RydWN0ZWQgaW4gYSBzaW1pbGFyIG1hbm5lcgoKYGBge3J9CmdncGxvdChyZXN1bHRzLCBhZXMoeCA9IGxvZ0ZDLCB5PS1sb2cxMChGRFIpKSkgKyBnZW9tX3BvaW50KCkKYGBgCgoKIyMgQ29tcG9zaW5nIHBsb3RzIHdpdGggZ2diaW8KCldlIHdpbGwgbm93IHRha2UgYSBicmllZiBsb29rIGF0IG9uZSBvZiB0aGUgdmlzdWFsaXNhdGlvbiBwYWNrYWdlcyBpbiBCaW9jb25kdWN0b3IgdGhhdCB0YWtlcyBhZHZhbnRhZ2UKb2YgdGhlIEdlbm9taWNSYW5nZXMgYW5kIEdlbm9taWNGZWF0dXJlcyBvYmplY3QtdHlwZXMuIEluIHRoaXMgc2VjdGlvbiB3ZSB3aWxsIHNob3cgYSB3b3JrZWQKZXhhbXBsZSBvZiBob3cgdG8gY29tYmluZSBzZXZlcmFsIHR5cGVzIG9mIGdlbm9taWMgZGF0YSBvbiB0aGUgc2FtZSBwbG90LiBUaGUgZG9jdW1lbnRhdGlvbiBmb3IKZ2diaW8gaXMgdmVyeSBleHRlbnNpdmUgYW5kIGNvbnRhaW5zIGxvdHMgb2YgZXhhbXBsZXMuCgpodHRwOi8vd3d3LnRlbmdmZWkubmFtZS9nZ2Jpby9kb2NzLwoKVGhlIGBHdml6YCBwYWNrYWdlIGlzIGFub3RoZXIgQmlvY29uZHVjdG9yIHBhY2thZ2UgdGhhdCBzcGVjaWFsaXNpbmcgaW4gZ2Vub21pYyB2aXN1YWxpc2F0aW9ucywgYnV0IHdlCndpbGwgbm90IGV4cGxvcmUgdGhpcyBwYWNrYWdlIGluIHRoZSBjb3Vyc2UuCgpUaGUgTWFuaGF0dGFuIHBsb3QgaXMgYSBjb21tb24gd2F5IG9mIHZpc3VhbGlzaW5nIGdlbm9tZS13aWRlIHJlc3VsdHMsIGFuZCB0aGlzIGlzIGltcGxlbWVudGVkIGFzIHRoZQpgcGxvdEdyYW5kTGluZWFyYCBmdW5jdGlvbi4gV2UgaGF2ZSB0byBzdXBwbHkgYSB2YWx1ZSB0byBkaXNwbGF5IG9uIHRoZSB5LWF4aXMgdXNpbmcgdGhlIGBhZXNgIGZ1bmN0aW9uLAp3aGljaCBpcyBpbmhlcml0ZWQgZnJvbSBnZ3Bsb3QyLiBUaGUgcG9zaXRpb25pbmcgb2YgcG9pbnRzIG9uIHRoZSB4LWF4aXMgaXMgaGFuZGxlZCBhdXRvbWF0aWNhbGx5IGJ5CmdnYmlvLCB1c2luZyB0aGUgcmFuZ2VzIGluZm9ybWF0aW9uIHRvIGdldCB0aGUgZ2Vub21pYyBjb29yZGluYXRlcyBvZiB0aGUgcmFuZ2VzIG9mIGludGVyZXN0LgoKVG8gc3RvcCB0aGUgcGxvdHMgZnJvbSBiZWluZyB0b28gY2x1dHRlcmVkIHdlIHdpbGwgY29uc2lkZXIgdGhlIHRvcCAyMDAgZ2VuZXMgb25seS4KCmBgYHtyfQpsaWJyYXJ5KGdnYmlvKQp0b3AyMDAgPC0gc2lnUmVnaW9uc1tvcmRlcihzaWdSZWdpb25zJExSLGRlY3JlYXNpbmcgPSBUUlVFKVsxOjIwMF1dCgpwbG90R3JhbmRMaW5lYXIodG9wMjAwICwgYWVzKHkgPSBsb2dGQykpCgpgYGAKCmBnZ2Jpb2AgaGFzIGFsdGVybmF0ZWQgdGhlIGNvbG91cnMgb2YgdGhlIGNocm9tb3NvbWVzLiBIb3dldmVyLCBhbiBhcHBlYWxpbmcgZmVhdHVyZSBvZiBgZ2dwbG90MmAgaXMgdGhlIGFiaWxpdHkgdG8gbWFwIHByb3BlcnRpZXMgb2YgeW91ciBwbG90IHRvIHZhcmlhYmxlcyBwcmVzZW50IGluIHlvdXIgZGF0YS4gRm9yIGV4YW1wbGUsIHdlIGNvdWxkIGNyZWF0ZSBhIHZhcmlhYmxlIHRvIGRpc3Rpbmd1aXNoIGJldHdlZW4gdXAtIGFuZCBkb3duLXJlZ3VsYXRlZCBnZW5lcy4gVGhlIHZhcmlhYmxlcyB1c2VkIGZvciBhZXN0aGV0aWMgbWFwcGluZyBtdXN0IGJlIHByZXNlbnQgaW4gdGhlIGBtY29sc2Agc2VjdGlvbiBvZiB5b3VyIHJhbmdlcyBvYmplY3QuCgpgYGB7cn0KbWNvbHModG9wMjAwKSRVcFJlZ3VsYXRlZCA8LSBtY29scyh0b3AyMDApJGxvZ0ZDID4gMAoKcGxvdEdyYW5kTGluZWFyKHRvcDIwMCwgYWVzKHkgPSBsb2dGQywgY29sID0gVXBSZWd1bGF0ZWQpKQpgYGAKCmBwbG90R3JhbmRMaW5lYXJgIGlzIGEgc3BlY2lhbCBmdW5jdGlvbiBpbiBgZ2diaW9gIHdpdGggcHJlc2V0IG9wdGlvbnMgZm9yIHRoZSBtYW5oYXR0YW4gc3R5bGUgb2YgcGxvdC4gTW9yZSBvZnRlbiwgdXNlcnMgd2lsbCBjYWxsIHRoZSBgYXV0b3Bsb3RgIGZ1bmN0aW9uIGFuZCBgZ2diaW9gIHdpbGwgY2hvb3NlIHRoZSBtb3N0IGFwcHJvcHJpYXRlIGxheW91dC4gT25lIHN1Y2ggbGF5b3V0IGlzIHRoZSAqa2FyeW9ncmFtKi4gCgpgYGB7cn0KCmF1dG9wbG90KHRvcDIwMCxsYXlvdXQ9ImthcnlvZ3JhbSIsYWVzKGNvbG9yPVVwUmVndWxhdGVkLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBmaWxsPVVwUmVndWxhdGVkKSkKCmBgYAoKCgpgZ2diaW9gIGlzIGFsc28gYWJsZSB0byBwbG90IHRoZSBzdHJ1Y3R1cmUgb2YgZ2VuZXMgYWNjb3JkaW5nIHRvIGEgcGFydGljdWxhciBtb2RlbCByZXByZXNlbnRlZCBieSBhIGBHZW5vbWljRmVhdHVyZXNgIG9iamVjdC4KCgpgYGB7cn0KYXV0b3Bsb3QodHgsIHdoaWNoPWV4b1tbIjI0MTE3Il1dKQpgYGAKCldlIGNhbiBldmVuIHBsb3QgdGhlIGxvY2F0aW9uIG9mIHNlcXVlbmNpbmcgcmVhZHMgaWYgdGhleSBoYXZlIGJlZW4gaW1wb3J0ZWQgdXNpbmcgcmVhZEdBbGlnbm1lbnRzCmZ1bmN0aW9uIChvciBzaW1pbGFyKS4KCmBgYHtyfQpteXJlZyA8LSBmbGFuayhyZWR1Y2UoZXhvW1siMjQxMTciXV0pLCAxMDAwLCBib3RoID0gVCkKYmFtIDwtIHJlYWRHQWxpZ25tZW50cyhmaWxlPSJiYW0vTUNMMS5ERy5iYW0iLAogICAgICAgICAgICAgICAgICAgICAgIHBhcmFtPVNjYW5CYW1QYXJhbSh3aGljaD1teXJlZyksdXNlLm5hbWVzID0gVFJVRSkKCmF1dG9wbG90KGJhbSx3aGljaD1teXJlZykKYGBgCgpgYGB7cn0KYXV0b3Bsb3QoYmFtICwgc3RhdCA9ICJjb3ZlcmFnZSIpCmBgYApMaWtlIGdncGxvdDIsIGdnYmlvIHBsb3RzIGNhbiBiZSBzYXZlZCBhcyBvYmplY3RzIHRoYXQgY2FuIGxhdGVyIGJlIG1vZGlmaWVkLCBvciBjb21iaW5lZCB0b2dldGhlciB0bwpmb3JtIG1vcmUgY29tcGxpY2F0ZWQgcGxvdHMuIElmIHNhdmVkIGluIHRoaXMgd2F5LCB0aGUgcGxvdCB3aWxsIG9ubHkgYmUgZGlzcGxheWVkIG9uIGEgcGxvdHRpbmcgZGV2aWNlCndoZW4gd2UgcXVlcnkgdGhlIG9iamVjdC4gVGhpcyBzdHJhdGVneSBpcyB1c2VmdWwgd2hlbiB3ZSB3YW50IHRvIGFkZCBhIGNvbW1vbiBlbGVtZW50IChzdWNoIGFzCmFuIGlkZW9ncmFtKSB0byBhIHBsb3QgY29tcG9zaXRpb24gYW5kIGRvbuKAmXQgd2FudCB0byByZXBlYXQgdGhlIGNvZGUgdG8gZ2VuZXJhdGUgdGhlIHBsb3QgZXZlcnkgdGltZS4KCmBgYHtyfQojaWRQbG90IDwtIHBsb3RJZGVvZ3JhbShnZW5vbWUgPSAibW0xMCIsc3ViY2hyID0gImNocjEiKQojaWRQbG90CmdlbmVNb2QgPC0gYXV0b3Bsb3QodHgsIHdoaWNoID0gbXlyZWcpCnJlYWRzMSA8LSBhdXRvcGxvdChiYW0sIHN0YXQgPSAiY292ZXJhZ2UiKQp0cmFja3MoZ2VuZU1vZCAscmVhZHMxKQpgYGAKCgo=